DevConf.IN 2025

Ruchi Pakhle

Software Engineer @Red Hat. Open Source Developer @AsyncAPI Initiative by Postman. LFX'22 @Open-Horizon


Company or affiliation

Red Hat

Job title

Software Engineer


Session

02-28
11:25
35min
Kafka Streams, Ansible Automates: Backbone for Building Scalable Event-Driven Systems
Ruchi Pakhle, Ruchika Suryawanshi

Managing enormous data streams while preserving smooth scalability is a critical challenge in the age of distributed systems. Businesses can function effectively in the face of constant data flow thanks to event-driven architectures, which offer the framework for processing billions of events in real time. We will examine how Apache Kafka and Ansible work together to create and administer reliable event-driven systems in this presentation.

Apache As the foundation of streaming infrastructures, Kafka enables enterprises to manage low-latency, high-throughput event processing. We'll learn how real-time data pipelines for use cases like analytics, monitoring, and microservices communication are supported by Kafka's distributed architecture. Ansible, on the other hand, acts as the automation wizard, maintaining configurations, coordinating Kafka deployments, and making sure systems are robust and fault-tolerant even as workloads scale.

This session will emphasise the following using real-time examples and useful code snippets:
How Kafka maintains fault tolerance and controls scalable data streams.
How Kafka cluster deployments and maintenance are automated and made simpler with Ansible.
Best practices for a smooth DevOps process that combine automation and real-time data streaming.
By the end of this session, you’ll walk away with a clear blueprint for leveraging Kafka and Ansible together to build dynamic, event-driven systems capable of scaling with your organization’s needs.

Cloud, Edge, and Platform Technologies
Torna Room (Chanakya Building / School of Business)