Session Type
Breakout Session
Name
Stream On: From Bottlenecks to Streamline with Kafka Streams Template
Date
Tuesday, May 20, 2025
Time
5:30 PM - 6:15 PM
Location Name
Breakout Room 6
Description
How do you make 10TB of data per hour accessible, scalable, and easy to integrate for multiple internal consumers? In this talk, we’ll share how we overcame storage throughput limitations by migrating to Kafka Streams and developing a unified template application. Our solution not only eliminated bottlenecks but also empowered internal clients to build reliable Kafka Streams applications in just a few clicks—focusing solely on business logic without worrying about infrastructure complexity.
We’ll dive into our architecture, implementation strategies, and key optimizations, covering performance tuning, monitoring, and how our approach accelerates adoption across teams. Whether you're managing massive data pipelines or seeking to streamline access for diverse stakeholders, this session will provide practical insights into leveraging Kafka Streams for seamless, scalable data flow.
Speakers
Level
Intermediate
Target Audience
Data Engineer/Scientist, Developer, Executive (Technical)
Industry
Technology
Tags
Apache Kafka