DevConf.US 2026

Building In-House Data Agents on RHOAI
2026-09-24 , 106 (Capacity 45)

As AI development moves toward agents that operate on real systems, data context becomes critical. Agents need to understand how data moves, recognize incorrect pipeline results, and take trusted action.

In this session, I will show how I built a data agent on Red Hat OpenShift AI using Apache Spark through the Kubeflow Spark Operator. An enriched context layer and MCP tools connect the agent to the data pipeline and its runtime.

The demo shows the agent detecting a broken Spark pipeline and using a diagnose-repair-validate loop to prepare a verified fix for human review. The goal is to show how users can build and scale their own in-house data agents on RHOAI and bring the agentic development lifecycle to enterprise data pipelines.