Operational resilience and Disaster Recovery (DR) through Kafka is indispensable for businesses to grow at a rapid pace in a high velocity and high risk environment of digital payments that PhonePe operates in. It has been core to our platform first approach from Day 1 and helped us drive widespread digital adoption in India. It ensures data integrity and availability thereby safeguarding user trust, business operations and regulatory compliance preventing financial losses. PhonePe has revolutionised India’s financial and digital landscape to build a cashless economy with financial traceability; and processes ~9 billion transactions/month which is almost 4 times the size of other global digital payment giants. This has enabled financial inclusion by empowering millions of Indians easy access to digital payments across both urban and rural India and including a 30 million vast merchant network. Join this session to learn how we demystified MirrorMaker2 for achieving DR in various ways through Kafka. We will talk about selection criteria for applications, different types of outages and the cost-benefit analysis for these applications. With MM2, we will explain how application-side dual writes challenge was resolved and the intricacies of setting up Shallow mirroring, Switch implementations with offset translation and Building automatic failure detectors. The session will also talk about Monitoring & Alerting and L7 proxy setup for transparent failovers. The audience would also have key takeaways on cluster architecture, rack-awareness for brokers, producers and consumers and implementation considerations from our learnings of setting up a platform – which is compliant by design, and able to scale to handle high volume and speed of data flow.
