Llamastack is a framework that standardizes the core building blocks needed to build AI powered applications. In this talk, we’ll show you how to run llamastack locally as a container, with either Ramalama or vLLM backends. Once running, we’ll also show how to utilize the llamastack server to build AI applications.

What you’ll learn:
* Containerizing Llamastack with a remote vLLM backend or Ramalama.
* Upgrading containers to Quadlet & systemd for better automation and management.
* Building an AI application using Llamastack, with real-world deployment strategies.

Participants will get guided, practical experience running AI workloads in containers locally. Whether you're an AI developer, MLOps engineer, or container enthusiast, this talk will equip you with the skills to efficiently deploy AI models in a modern, containerized environment. Bring your laptop and be ready to get hands-on!