DevConf.US 2025

Toufic Boubez

Toufic Boubez is a visionary technologist, seasoned entrepreneur, and people-first executive with over 25 years of leadership experience spanning AI, cloud infrastructure, SOA architecture, and product innovation. He currently serves as Co-Founder and CTO of Catio, the world’s first AI-powered Copilot for tech architecture. Catio has built an intelligent platform that helps CTOs, architects, and developers plan, optimize, and future-proof technology investments with continuous visibility and ROI-driven AI insights.A serial entrepreneur with three successful exits, Toufic co-founded and served as CTO of Metafor Software (acquired by Splunk), Layer 7 Technologies (acquired by CA Technologies), and Saffron Technology (acquired by Intel), in addition to his role as CTO at Catio. His ventures have been repeatedly recognized as Gartner Cool Vendors and industry leaders.
Before Catio, he was CTO and Chief Product Officer at MacroHealth, where he built Architecture, Engineering, Product Management, Data Science, and UX teams from the ground up, transforming the company from an advisory consultancy into a cloud-native healthcare technology leader. He spearheaded the development of a modern healthcare claims exchange and optimization platform, and led a successful $41 million Series A fundraise.As VP of Engineering, Machine Learning & Incubation at Splunk, Toufic launched the Splunk ML Platform and Toolkit, and drove innovation in NLP, IoT, streaming analytics, and next-generation SaaS architecture. Earlier in his career, as Chief Architect for SOA at IBM, he co-authored key web services standards, co-edited W3C specifications, and pioneered XML-based service architectures.Toufic holds a Ph.D. in Biomedical Engineering from Rutgers University, where his research focused on multiresolution and compact support in neural network simulations. He is an inventor on multiple patents across IBM, Splunk, and his own startups, and the author of Building Web Services with Java and Java P2P Unleashed. He has chaired major international conferences, delivered numerous keynotes, and been recognized by CRN and InfoWorld as one of the industry’s top technology innovators.


Job title

Ph.D., Co-Founder & CTO

Company or affiliation

Catio


Session

09-19
15:20
35min
Building an AI Agent Orchestration Framework for Enterprise Architecture with AWS Bedrock, Flyte, and LangGraph
Toufic Boubez

As LLMs move into enterprise workflows, developers face a new kind of architecture challenge: how do you build reliable, interpretable systems powered by agents and reasoning?

This talk unpacks how we designed and implemented an AI orchestration framework for enterprise architecture — combining LangGraph for multi-agent workflows, Flyte for distributed execution, and AWS Bedrock for LLM inference using Claude 3. The product: an AI copilot for enterprise architects, deeply rooted in your tech stack context.

At the core of this system is a domain-specific knowledge graph that acts as long-term memory for the agents. It enables persistent, structured representations of architectural state, system dependencies, and business context — giving the agents the grounding they need to generate accurate recommendations, translate natural language into SQL or code, and maintain continuity across workflows.

We’ll also cover how we’ve integrated observability practices — including planned OpenTelemetry instrumentation — to trace and debug autonomous AI systems in production.

If you’re a developer or AI engineer thinking beyond the chatbot and looking to embed reasoning into complex system design and data tasks, this talk offers an end-to-end blueprint — from orchestration and grounding to production monitoring.

Artificial Intelligence and Data Science
Ladd Room (Capacity 96)