Session Type
Breakout Session
Name
Migrating Kafka from ZooKeeper to KRaft: adventures in operations
Date
Wednesday, May 21, 2025
Time
1:00 PM - 1:45 PM
Location Name
Breakout Room 4
Description
From version 4.0 of Kafka, clusters will not support ZooKeeper anymore. This is a change that has been in the works for a while, and Kafka now has its own consensus protocol named KRaft. If you want to create a new Kafka cluster, using KRaft is pretty straightforward, but what if you already have existing Kafka clusters? Since Kafka 3.6, you can migrate ZooKeeper based clusters to KRaft. The process has a few intricacies about it and even more so if you want to automate it, rather than doing it manually for each cluster. In this session we will take you along for the ride of migrating a ZooKeeper based Kafka cluster, to a KRaft one. We’ll share the pitfalls we discovered while implementing an automated process in the open source Kafka operator Strimzi to handle this operation. It was certainly an adventure, so come along to see how you can navigate this migration as smoothly as possible, by avoiding a lot of error-prone manual steps on your production clusters.
Kate Stanley Paolo Patierno
Level
Intermediate
Target Audience
Operator/Administrator
Tags
Apache Kafka, Operations, Cloud