In the fast-evolving e-commerce space, managing and processing vast amounts of data is paramount to delivering superior experiences. Join this session to understand how Shiprocket solves this business challenge and handles over ~1 billion events daily, with Apache Kafka serving as the backbone of our architecture, enabling seamless real-time data streaming and processing, and Event decoupling. In this session, we dissect and discuss the following : - How a multi-tenant architecture, supporting more than 1,400 databases and 50,000 tables, addresses the complexity of decentralized data management and real-time querying. - Implementing effective Change Data Capture (CDC) processes has been key to achieving real-time insights across this distributed landscape. - How we enable seamless real-time microservices communication, Buyer communications, and third-party webhooks, managing ~50 million interactions daily. This capability ensures a smooth e-commerce experience for all stakeholders. Shiprocket has deep innovations linked to this platform which streamlines commerce and empowers merchants to thrive in the dynamic e-commerce ecosystem, domestically and internationally. Attendees will leave the room with practical insights into scaling high-volume, multi-tenant systems using Apache Kafka. They will also learn how Kafka drives Shiprocket’s data platform and how our hybrid architecture—combining Confluent-managed Kafka with In-house Kubernetes deployments (powered by Strimzi)—strikes the perfect balance between cost efficiency and operational control. The session will also highlight key challenges faced while scaling Kafka and the architectural optimizations that significantly enhanced its performance.

