Kafka ZooKeeper to KRaft Config Converter

Turn a ZooKeeper-mode server.properties into a KRaft one. Every setting is sorted into carries across, renamed, or no equivalent at all, and nothing is dropped silently: the ones with no counterpart are commented with the reason.

Three controllers tolerate one failure; an even number tolerates the same as the odd number below it. Combined mode is for development, where it saves running separate processes.

Paste below, or drop a file anywhere on this panel

Or drop a file anywhere on this panel. Nothing is uploaded: the analysis runs in this tab.

The answer appears here

Paste on the left and press Convert. Nothing leaves this tab.

Examples

Real input you can load into the tool above. Each one shows a different thing going wrong, because that is what the tool is for.

A ZooKeeper broker config

What converts, what has no KRaft equivalent, and why this is a migration not a conversion

zookeeper.connect=zk:2181
broker.id=1
log.dirs=/var/lib/kafka

Controller quorum

The settings a KRaft cluster needs that a ZooKeeper one never had

broker.id=1
log.dirs=/var/lib/kafka
num.partitions=6

Common mistakes

These are the ones that fail silently. The config is accepted, nothing raises an error, and the consequence arrives later.

  1. Treating the config conversion as the migration

    Converting settings is the easy part. The metadata itself has to move, which is a documented multi-step procedure with a dual-write phase.

    Instead:Follow the migration procedure. This page only shows the config side.

  2. Forgetting to format the storage directory

    KRaft needs kafka-storage.sh format with a cluster id before the first start, which ZooKeeper never required.

    Instead:Format before starting, and keep the cluster id.

  3. Assuming every setting has an equivalent

    Several ZooKeeper-era settings have no KRaft counterpart and are simply gone.

    Instead:Read the ones flagged as having no equivalent rather than translating them.

Converting the config is the easy half

Most settings carry across untouched. The ones that do not divide into renames, which are harmless, and settings with no KRaft equivalent at all, which is where a migration goes wrong.

The authorizer class changes, and nothing about its name says so

AclAuthorizer stores and reads ACLs in ZooKeeper, so it cannot work in KRaft; StandardAuthorizer keeps them in the metadata log. A KRaft broker configured with the ZooKeeper authorizer fails to start. Worse, converting the config without running the actual metadata migration leaves you with an authorizing cluster whose ACLs are still in ZooKeeper, which denies everything. This is the single most commonly missed step.

# ZooKeeper mode
authorizer.class.name=kafka.security.authorizer.AclAuthorizer

# KRaft
authorizer.class.name=org.apache.kafka.metadata.\
  authorizer.StandardAuthorizer

inter.broker.protocol.version stops doing anything

In KRaft the cluster-wide protocol level is a feature called metadata.version, raised with kafka-features rather than by editing every broker's config. Left in a KRaft server.properties it is simply ignored. That matters because pinning it is what gives a rolling upgrade its rollback window: a config carried across looks pinned and is not.

Log directories have to be formatted before first start

KRaft keeps cluster metadata in the log directory, so kafka-storage format runs once per node with the same cluster id across the whole cluster. A node started against an unformatted directory refuses to start; one formatted with a different cluster id refuses to join. Generate the id once and reuse it everywhere.

KAFKA_CLUSTER_ID=$(bin/kafka-storage.sh random-uuid)

# on every node, with the SAME id
bin/kafka-storage.sh format \
  --cluster-id $KAFKA_CLUSTER_ID \
  --config config/server.properties

An even number of controllers buys nothing

The controller quorum needs a majority, so tolerance is (n-1)/2 rounded down: one controller tolerates no failures, three tolerate one, five tolerate two. Two controllers tolerate no failures and cost twice as much as one, because losing either loses the majority. Three is the answer for almost every cluster.

Combined mode is for laptops

process.roles=broker,controller puts the quorum on the same JVMs serving client traffic, so a broker under load is a controller under load and losing a node loses both roles. It is genuinely fine for development and Kafka's own documentation recommends dedicated controllers for production.

This is not a migration tool

It produces the config a KRaft node needs, which is what you want for a new cluster or as the target state for a real migration. Moving an existing cluster's topics, ACLs and consumer offsets out of ZooKeeper is a separate operation that runs on a 3.x release and must complete before the 4.0 upgrade, because 4.0 has no ZooKeeper support left to migrate from. The version compatibility reference on this site has the ordering.

More kafka tools

Kafka Confluent Wire Format Decoder The five junk bytes in front of your payload Kafka Key to Partition Mapper Which partition does this key land on? Kafka Topic Name Validator Legal, risky, or 249 characters too long? Kafka Replication Safety Checker How many brokers can you lose Kafka Producer Config Linter Will it start, and will it lose a record? Kafka Message Payload Decoder The first five bytes are usually not data Kafka Connect Source Connector Generator tasks.max is a ceiling, not a count Kafka Connect Sink Connector Generator A dead letter queue with no context headers is a pile of records Kafka Connect SMT Chain Builder The order is the transforms list Kafka MirrorMaker 2 Config Generator It renames every topic by default Kafka Partition Reassignment Generator The throttle is not optional Strimzi Kafka Resource Generator Without the cluster label, nothing happens Kafka mTLS Config Generator The certificate is the identity Kafka Schema Registry Config Generator The compatibility direction is your deployment order Kafka Exactly-Once Config Generator Half of it is worse than none Kafka Broker and KRaft Config Generator The internal topics that break a one-broker cluster Kafka Quota Generator Byte rates are per broker, not per cluster Kafka Streams Config Generator application.id is four things at once Kafka Connect Worker Config Generator Security three times, or the tasks fail Kafka Retention and Unit Converter log.retention.hours does not take milliseconds Kafka Timestamp Converter Two sentinels and two meanings Kafka .properties to YAML Converter Dotted keys stay flat Kafka Streams Internal Topic Predictor Create them before Streams does Kafka ACL Generator The grant you forgot is on another resource type Kafka Topic Config Generator min.insync.replicas is the one that matters Kafka client.properties Generator The file every CLI tool asks for Kafka Producer Config Generator No password field, on purpose Kafka Consumer Config Generator The commit mode decides the semantics Kafka Disk and Retention Calculator retention.bytes is per partition Kafka Partition Count Calculator The number you can never reduce Kafka Cluster Sizing Calculator The traffic no client metric shows Kafka Consumer Lag Catch-Up Calculator Whether it ever clears, not just when Kafka Producer Batching Calculator linger.ms=0 still batches Kafka Segment and Index Sizing Why retention.ms is a lower bound Kafka Rebalance Duration Estimator What a rolling restart really costs Kafka Cost Estimator Your rates, so nothing goes stale Kafka Config Explorer by Version The answer depends on the release Kafka Default Config Reference What moved under a config you never edited Kafka OAuth Bearer Token Decoder Will Kafka accept it, and can it refresh Kafka Record Header Viewer Headers are a list, not a map Kafka Topic Regex Subscription Tester Kafka matches the whole name Kafka ACL Permission Matrix Viewer DENY beats every ALLOW Kafka Connect Config Validator The mistakes that raise no error Kafka Consumer Group Id Validator Which broker coordinates the group Kafka Partition Assignment Visualizer Leadership is the load, not replicas Kafka Consumer Assignment Visualizer The three assignors disagree Kafka Config to Strimzi Half of it belongs elsewhere Kafka Docker Compose Generator (KRaft) Reachable from inside and outside Kafka JAAS Config Decoder The line that stops SASL working Kafka CRC32C Calculator Which CRC, over which bytes Kafka Config Upgrade Checker What breaks when you upgrade Kafka Kafka Config Diff Which change actually changed something Kafka Consumer Config Linter Why the group rebalances, and where the records went Kafka Avro Schema Validator The defaults Avro accepts and rejects Kafka Schema Compatibility Checker What the registry will say, before you ask it Kafka Avro Schema Diff Which direction each change breaks Kafka Compression Comparison Measured on your bytes Kafka Delivery Semantics Exactly-once has a consumer half Kafka ksqlDB Query Builder It looks like SQL and the rules are not Kafka Connect SMT Predicate Tester negate reads backwards Kafka Streams Topology Viewer Count the repartitions Kafka Connect Pipeline Visualizer The order things really run in Kafka Protobuf Binary Decoder Works without the .proto Kafka Protobuf JSON Converter Why your JSON does not round-trip Kafka Protobuf to Avro Schema What does not survive the conversion Kafka Avro Binary Decoder Wrong schema, no error Kafka Avro JSON Converter Why the console producer rejects your line Kafka Avro Sample Data Generator Records that actually serialize Kafka JSON to Avro Schema What JSON cannot tell you Kafka JSON Schema to Avro What does not survive the conversion Kafka SASL JAAS Generator One login module, four syntaxes Kafka CLI Command Builder kcat is librdkafka, not Kafka

Elsewhere on the site