DevConf.US 2026

Trust but Isolate: Securing LLM Tool Execution with MicroVM Sandboxing
2026-09-24 , 106 (Capacity 45)

LLM-powered agents are rapidly moving from passive assistants to systems that can execute real commands modifying infrastructure, querying systems, and even remediating failures. This introduces a critical risk: how do we safely execute AI-generated actions without exposing the host system to prompt injection, hallucinations, or malicious inputs?

This talk presents a production-ready architecture that uses microVM-based sandboxing to isolate LLM tool execution. By leveraging lightweight virtualization such as Firecracker and Kata Containers, each AI-generated command is executed inside an ephemeral, disposable virtual environment, ensuring strong isolation with minimal overhead.

We demonstrate how LLM served via vLLM or running locally with llama.cpp can safely interact with system tools through a controlled execution pipeline. The session includes a live demo where prompt injection attempts are neutralized by sandbox policies, proving that AI can act autonomously without compromising security.


What level of experience should the audience have to best understand your session?: Intermediate - attendees should be familiar with the subject

Software Engineer @ Red Hat
I am currently working on cloud-native and automation-driven solutions. With a growing focus on DevOps and GitOps practices, he enjoys building and experimenting with technologies like Kubernetes and Argo CD.

Currently, I am exploring how AI can enhance deployment workflows and bring smarter decision-making into modern infrastructure systems. I am an active learner who shares his progress through projects, write-ups, and community discussions.

Software Engineer