2025-06-13 –, D105 (capacity 300)
In this session, it will be demonstrated a streamlined method for setting up a home lab to develop and test Large Language Models (LLMs) using Podman AI Lab. The process begins with deploying and refining LLMs locally on a developer's workstation using InstructLab. Once these models are matured, it will be explained how to transition them seamlessly to OpenShift AI using a local OpenShift cluster setup or even a cloud sandbox instance. This approach offers a simple yet effective way to experiment with LLMs locally and scale to a production-ready environment.
Intermediate - attendees should be familiar with the subject
Alexon has been working as a Principal Technical Account Manager at Red Hat since 2018, working in the Services organization focusing on Infrastructure and Management, Integration and Automation, Cloud Computing, and Storage Solutions. He is a part of the TAM Practices LATAM team based in São Paulo, Brazil, where his job is partnering with, advocating, trust-advising, and supporting customers in their success goals while making use of the complete portfolio. He also contributes to produce and enhance documentation, knowledge-base articles, blog posts, presentations, webinars, and workshops. He is a member of numerous communities, like Red Hat Academy, Red Hat Accelerators, OpenInfra Foundation and others. When he’s not at work, he enjoys spending quality time with his family (wife, two children, and cat) and participating in several volunteer jobs.