DevConf.US 2026

Rafael Vasquez

Rafael Vasquez is a software developer on the Open Tech team at IBM Research, where he contributes to open-source projects like vLLM and previously helped maintain KServe/ModelMesh. He enjoys sharing what he learns through conference talks, mentoring contributors, and creating tutorials for the developer community. His background spans self-driving car research, retail data science, and now the fast-moving world of LLMs and open source.


Job title:

Open Source Software Developer

Company or affiliation:

IBM


Sessions

09-24
15:20
35min
Agentic AI in Open Source Development: From Autopilot to Co-Pilot
James Busche, Rafael Vasquez

Agentic AI systems are transforming how developers approach the Software Development Lifecycle, enabling a shift from "coder of every line" to "architect of outcomes." These autonomous agents understand context, reason about complex problems, and execute multi-step workflows across the entire SDLC. We will demonstrate how agentic AI tools accelerate open source development while maintaining code quality and security.

The session will include:

  • Overview of agentic AI capabilities: multi-file refactoring, legacy modernization, security-first development, and knowledge transfer.
  • Architectural patterns for AI integration: Model Context Protocol (MCP) for connecting to external systems and Agent Skills for domain-specific guidance.
  • Demonstrations of context management, spec-driven development, MCP-based integrations, and agent skill implementation.
  • Best practices for balancing automation with human oversight in open source projects.

Attendees will leave with practical understanding of how to leverage agentic AI to accelerate development, while simultaneously maintaining control using intent-based specifications in their open source projects.

Target Audience

Open source maintainers, software architects, DevOps engineers, and developers interested in AI-assisted development

Artificial Intelligence and Data Science
Ladd Room (Capacity 170)
09-25
13:10
35min
Portrait of a Server on Fire
Rafael Vasquez

In this talk, we will introduce vLLM and explore why monitoring matters for LLM serving. We'll start from why serving LLMs is hard in the first place and build up to what that complexity looks like as real, observable metrics.

vLLM is a high-performance library designed for LLM inference and serving. Its core optimizations, including PagedAttention, continuous batching, and memory management, directly shape the behavior you'll see in production. Understanding what those techniques are doing under the hood makes it easier to understand what your metrics are actually telling you.

The session will include a demo showing how to instrument vLLM with observability tooling and interpret the signals that matter: KV cache usage, request queue depth, and end-to-end latency. No GPU or production cluster required. Just a small model running locally and some practical monitoring tools.

By the end of this session, you'll have a clearer mental model of LLM serving, a working understanding of vLLM's built-in observability, and the monitoring foundation to understand what's happening inside your server before something goes wrong.

Artificial Intelligence and Data Science
Ladd Room (Capacity 170)