← All sessions
Lightning Talk · 7 min

A Practical Guide to Fast and Private LLMs

Time
12:20–12:27
Room
Millennium
Times and rooms can change at any time, also during the conference. This page always shows the current schedule, check it on the day.

A set of practical tips and tools for hobbyists and teams to run their own LLM in a private and sustainable setup. This talk gives people hands-on knowledge to decide on the right LLM architecture, how to optimize it, which hardware to run it on, and what software stack to go for. A whirlwind tour of how to roll your own AI for fun and profit.

Main tools & technology
Llama.cpp, Ollama, vLLM
Topics
Local AI, Inference & Open Models
Become a sponsor

Put your tools, products, and engineering work in front of builders working with agentic AI.

Sponsors & Partners
Main Sponsor
copebit — Main Sponsor
Gold
AWS TD SYNNEX Exasol
Silver
Atlassian Flagsmith LogicStar namespace re:cinq
Hands-On
OpenAI — Workshop Partner
End-User
Migros Online — End User Partner
Education
FHNW Hochschule für Informatik — Educational Partner
Bronze
adesso BI Concepts Keera Noser Engineering Peak Scale Puzzle ITC Team Extension Trustsoft Your Sidekicks AG
Community
AI & ML Events All Day AI CH Open dev.events Global AI Zurich Java User Group Switzerland Rocket Engineers SwissAIJob SwissDevJobs ZurichJS Conference