2025-06-16 –, Kesselhaus
Want to avoid cloud-hosted AIs, and run your LLMs on your own systems, but not sure where to start? Or even what everything means? Join us to see how easy it can be, and what a beginner needs to know!
There are some great cloud-hosted AI systems out there, but they aren't right for everyone. Maybe it's cost, or environmental impact. Data sovereignty, privacy or control. Whatever your reason, it can be daunting to figure out how to get started. Luckily, it doesn't have to be!
We'll guide you through the key terms to know, where to find good AI / LLM models (it isn't github!), and how to run them. We'll see what influences memory and processing needs, and how fine-tuning can help. And even what that is! We'll help kick-start your journey to running models you control on your own hardware.
We'll even have some live demos of models running on a laptop!
Data Science, Operations
Level:Beginner
Nick is has been heavily involved in a number of Apache projects, such as Tika and POI, while having the fortune to know many of the people involved in the Apache Big Data and Search space! When not helping out with Apache things, Nick works as the Director of Engineering at Saible, where he leads a team making heavy use of Open Source technologies. When not helping ensure everyone gets paid, he is often to be found attending or organising BarCamps, Geek Nights, or other such fun events dedicated to sharing what's great and new!