Kafka Broker and KRaft Config Generator

A KRaft server.properties, with the listener wiring and the internal topic replication both sized for the cluster you actually have.

Node identity and role

Kafka 4.0 removed ZooKeeper, so this generates a KRaft configuration. 3.9 is the last release that can run either mode.

Topic defaults

On by default in Kafka and off here. Auto-creation makes a typo in a topic name create a topic instead of failing, with the broker defaults rather than the ones you wanted.

Security

No password field, on purpose. The output references a mounted secret through Kafka's own FileConfigProvider and the commands to create it are in the notes.

server.properties

updates as you type

    Common mistakes

    These are the ones that fail silently. The config is accepted, nothing raises an error, and the consequence arrives later.

    1. Running one broker with default internal topic settings

      __consumer_offsets and the transaction log default to a replication factor of three. On a single broker they cannot be created and consumers fail with a confusing error.

      Instead:Set offsets.topic.replication.factor and transaction.state.log.replication.factor to 1 for a single-broker setup.

    2. Setting min.insync.replicas equal to the replication factor

      One broker restarting then stops all acks=all writes. There is no headroom for routine maintenance.

      Instead:min.isr = RF - 1.

    3. Leaving auto.create.topics.enable on

      A typo in a topic name silently creates a topic with default partitions and replication, which then looks like data loss.

      Instead:Turn it off outside development.

    Where a KRaft broker config goes wrong

    Almost all of it is the listener wiring, plus one default that breaks every small cluster.

    The internal topics default to replication factor 3

    offsets.topic.replication.factor, transaction.state.log.replication.factor and transaction.state.log.min.isr all default to values a one or two broker cluster cannot satisfy. Nothing fails at startup: the broker comes up healthy, and then the first consumer to connect cannot have __consumer_offsets created for it and fails with an error about that topic rather than about the broker count. This generator caps them at the cluster size for exactly that reason.

    controller.quorum.voters is id@host:port

    The node id is part of each entry and it is not optional. A plain host:port list produces a quorum that never forms, and the broker log fills with controller connection messages that never say the format is wrong. Each id has to match that controller's own node.id, and the voter set is fixed at format time unless you are on 3.9 or later with dynamic quorums.

    listeners is what it binds, advertised.listeners is what clients are told

    Binding 0.0.0.0 is correct and advertising it is not, because every client would then try to connect to 0.0.0.0. The advertised address has to be one the client can resolve and reach, which inside Kubernetes means the pod's own stable address, and that is why a Kafka StatefulSet exists rather than a Deployment.

    The controller listener carries Raft and nothing else

    inter.broker.listener.name must name a different listener from the one in controller.listener.names. Pointing broker traffic at the controller listener fails validation at startup. A combined-role node runs both listeners on different ports for this reason, and a controller-only node has no broker listener at all.

    What this cannot see

    It does not know your hardware, your topic count or your throughput, so nothing here is a capacity decision: the cluster sizing calculator on this site answers how many brokers, and the disk calculator answers how much storage. It also cannot format your storage directory, which has to happen before the first start with kafka-storage.sh and a cluster id shared by every node.

    More kafka tools

    Kafka Confluent Wire Format Decoder The five junk bytes in front of your payload Kafka Key to Partition Mapper Which partition does this key land on? Kafka Topic Name Validator Legal, risky, or 249 characters too long? Kafka Replication Safety Checker How many brokers can you lose Kafka Producer Config Linter Will it start, and will it lose a record? Kafka Message Payload Decoder The first five bytes are usually not data Kafka Connect Source Connector Generator tasks.max is a ceiling, not a count Kafka Connect Sink Connector Generator A dead letter queue with no context headers is a pile of records Kafka Connect SMT Chain Builder The order is the transforms list Kafka MirrorMaker 2 Config Generator It renames every topic by default Kafka Partition Reassignment Generator The throttle is not optional Strimzi Kafka Resource Generator Without the cluster label, nothing happens Kafka mTLS Config Generator The certificate is the identity Kafka Schema Registry Config Generator The compatibility direction is your deployment order Kafka Exactly-Once Config Generator Half of it is worse than none Kafka Quota Generator Byte rates are per broker, not per cluster Kafka Streams Config Generator application.id is four things at once Kafka Connect Worker Config Generator Security three times, or the tasks fail Kafka Retention and Unit Converter log.retention.hours does not take milliseconds Kafka Timestamp Converter Two sentinels and two meanings Kafka .properties to YAML Converter Dotted keys stay flat Kafka Streams Internal Topic Predictor Create them before Streams does Kafka ACL Generator The grant you forgot is on another resource type Kafka Topic Config Generator min.insync.replicas is the one that matters Kafka client.properties Generator The file every CLI tool asks for Kafka Producer Config Generator No password field, on purpose Kafka Consumer Config Generator The commit mode decides the semantics Kafka Disk and Retention Calculator retention.bytes is per partition Kafka Partition Count Calculator The number you can never reduce Kafka Cluster Sizing Calculator The traffic no client metric shows Kafka Consumer Lag Catch-Up Calculator Whether it ever clears, not just when Kafka Producer Batching Calculator linger.ms=0 still batches Kafka Segment and Index Sizing Why retention.ms is a lower bound Kafka Rebalance Duration Estimator What a rolling restart really costs Kafka Cost Estimator Your rates, so nothing goes stale Kafka Config Explorer by Version The answer depends on the release Kafka Default Config Reference What moved under a config you never edited Kafka OAuth Bearer Token Decoder Will Kafka accept it, and can it refresh Kafka Record Header Viewer Headers are a list, not a map Kafka Topic Regex Subscription Tester Kafka matches the whole name Kafka ACL Permission Matrix Viewer DENY beats every ALLOW Kafka Connect Config Validator The mistakes that raise no error Kafka Consumer Group Id Validator Which broker coordinates the group Kafka Partition Assignment Visualizer Leadership is the load, not replicas Kafka Consumer Assignment Visualizer The three assignors disagree Kafka ZooKeeper to KRaft Config Converter The authorizer class nobody changes Kafka Config to Strimzi Half of it belongs elsewhere Kafka Docker Compose Generator (KRaft) Reachable from inside and outside Kafka JAAS Config Decoder The line that stops SASL working Kafka CRC32C Calculator Which CRC, over which bytes Kafka Config Upgrade Checker What breaks when you upgrade Kafka Kafka Config Diff Which change actually changed something Kafka Consumer Config Linter Why the group rebalances, and where the records went Kafka Avro Schema Validator The defaults Avro accepts and rejects Kafka Schema Compatibility Checker What the registry will say, before you ask it Kafka Avro Schema Diff Which direction each change breaks Kafka Compression Comparison Measured on your bytes Kafka Delivery Semantics Exactly-once has a consumer half Kafka ksqlDB Query Builder It looks like SQL and the rules are not Kafka Connect SMT Predicate Tester negate reads backwards Kafka Streams Topology Viewer Count the repartitions Kafka Connect Pipeline Visualizer The order things really run in Kafka Protobuf Binary Decoder Works without the .proto Kafka Protobuf JSON Converter Why your JSON does not round-trip Kafka Protobuf to Avro Schema What does not survive the conversion Kafka Avro Binary Decoder Wrong schema, no error Kafka Avro JSON Converter Why the console producer rejects your line Kafka Avro Sample Data Generator Records that actually serialize Kafka JSON to Avro Schema What JSON cannot tell you Kafka JSON Schema to Avro What does not survive the conversion Kafka SASL JAAS Generator One login module, four syntaxes Kafka CLI Command Builder kcat is librdkafka, not Kafka

    Elsewhere on the site