Kafka Consumer Assignment Visualizer

See which partitions each consumer in a group would get, under each of Kafka's three built-in assignors. The algorithms are the real ones, so the assignment is what the coordinator would actually hand out.

All three are computed whichever you pick, so the comparison is always in the output. Member ids are sorted the way the coordinator sorts them, which is what makes range's block boundaries land where they do.

Paste below, or drop a file anywhere on this panel

Or drop a file anywhere on this panel. Nothing is uploaded: the analysis runs in this tab.

The answer appears here

Paste on the left and press Assign. Nothing leaves this tab.

Examples

Real input you can load into the tool above. Each one shows a different thing going wrong, because that is what the tool is for.

More consumers than partitions

Consumers that will sit idle, because a partition goes to exactly one member and the topic has six

consumer-1
consumer-2
consumer-3
consumer-4
consumer-5
consumer-6
consumer-7
consumer-8

An even assignment

Three consumers over six partitions, which is what range and roundrobin agree on

consumer-1
consumer-2
consumer-3

Common mistakes

These are the ones that fail silently. The config is accepted, nothing raises an error, and the consequence arrives later.

  1. Running more consumers than partitions

    A partition goes to exactly one consumer in a group, so the extras idle and add rebalance cost.

    Instead:Scale consumers up to the partition count, no further.

  2. Assuming assignors agree

    range, roundrobin, sticky and cooperative-sticky produce different assignments, and range in particular skews across multiple topics.

    Instead:Set partition.assignment.strategy deliberately.

  3. Ignoring the rebalance protocol

    The eager protocol stops every consumer on any membership change. Cooperative only moves the partitions that need moving.

    Instead:Use cooperative-sticky unless something prevents it.

The three built-in assignors give different answers to the same question

Kafka's assignors are implemented here, not approximated, so the assignment shown is the one the group would get. The comparison is the point: the default is rarely the best of the three.

RangeAssignor works per topic, and that concentrates the low partitions

Range sorts the members, then for each topic separately hands out contiguous blocks starting from the first member. Subscribe to five topics of three partitions each with three members and member 0 gets partition 0 of all five. When partition 0 is hot, which on a keyed topic with a skewed key space it often is, that skew lands on the same consumer every time. It is also the default for the plain consumer, which is why this shape is so common.

3 members, topics orders=3 payments=3

range        m0: orders-0 payments-0
             m1: orders-1 payments-1
             m2: orders-2 payments-2

# fine here. With uneven partition counts the
# remainders pile onto the early members instead of
# averaging out across topics.

RoundRobinAssignor spreads better and moves almost everything

It lays every partition of every subscribed topic into one list and deals them round robin. The balance across multiple topics is better than range. The cost is that any membership change shifts the deal by one, so nearly every partition moves to a different consumer, which for a stateful consumer means rebuilding nearly every cache.

Stickiness is invisible in a first assignment

With no previous assignment to preserve, the sticky assignors aim purely for balance and produce the same shape as round robin. Their advantage shows up on the second assignment, where they keep members on the partitions they already had. This tool computes assignments from scratch, so it shows you the balance and not the stickiness, and it says so rather than implying otherwise. Balance is only half of why CooperativeStickyAssignor is the right default; the other half is that it revokes only the partitions that move.

Eager against cooperative is a different axis

Range and round robin both use the eager protocol: every partition is revoked from every member before reassignment, including the ones coming straight back. CooperativeStickyAssignor revokes only what moves and pays two rounds for it. The rebalance duration estimator on this site quantifies the difference; this page shows what each one assigns.

More consumers than partitions is permanent waste

Partitions are the ceiling on consumer parallelism. An extra consumer is assigned nothing, and it still joins every rebalance and still counts toward the join barrier, so it makes rebalances slower while consuming nothing. Partitions can be added and never removed, so the count is worth deciding up front.

More kafka tools

Kafka Confluent Wire Format Decoder The five junk bytes in front of your payload Kafka Key to Partition Mapper Which partition does this key land on? Kafka Topic Name Validator Legal, risky, or 249 characters too long? Kafka Replication Safety Checker How many brokers can you lose Kafka Producer Config Linter Will it start, and will it lose a record? Kafka Message Payload Decoder The first five bytes are usually not data Kafka Connect Source Connector Generator tasks.max is a ceiling, not a count Kafka Connect Sink Connector Generator A dead letter queue with no context headers is a pile of records Kafka Connect SMT Chain Builder The order is the transforms list Kafka MirrorMaker 2 Config Generator It renames every topic by default Kafka Partition Reassignment Generator The throttle is not optional Strimzi Kafka Resource Generator Without the cluster label, nothing happens Kafka mTLS Config Generator The certificate is the identity Kafka Schema Registry Config Generator The compatibility direction is your deployment order Kafka Exactly-Once Config Generator Half of it is worse than none Kafka Broker and KRaft Config Generator The internal topics that break a one-broker cluster Kafka Quota Generator Byte rates are per broker, not per cluster Kafka Streams Config Generator application.id is four things at once Kafka Connect Worker Config Generator Security three times, or the tasks fail Kafka Retention and Unit Converter log.retention.hours does not take milliseconds Kafka Timestamp Converter Two sentinels and two meanings Kafka .properties to YAML Converter Dotted keys stay flat Kafka Streams Internal Topic Predictor Create them before Streams does Kafka ACL Generator The grant you forgot is on another resource type Kafka Topic Config Generator min.insync.replicas is the one that matters Kafka client.properties Generator The file every CLI tool asks for Kafka Producer Config Generator No password field, on purpose Kafka Consumer Config Generator The commit mode decides the semantics Kafka Disk and Retention Calculator retention.bytes is per partition Kafka Partition Count Calculator The number you can never reduce Kafka Cluster Sizing Calculator The traffic no client metric shows Kafka Consumer Lag Catch-Up Calculator Whether it ever clears, not just when Kafka Producer Batching Calculator linger.ms=0 still batches Kafka Segment and Index Sizing Why retention.ms is a lower bound Kafka Rebalance Duration Estimator What a rolling restart really costs Kafka Cost Estimator Your rates, so nothing goes stale Kafka Config Explorer by Version The answer depends on the release Kafka Default Config Reference What moved under a config you never edited Kafka OAuth Bearer Token Decoder Will Kafka accept it, and can it refresh Kafka Record Header Viewer Headers are a list, not a map Kafka Topic Regex Subscription Tester Kafka matches the whole name Kafka ACL Permission Matrix Viewer DENY beats every ALLOW Kafka Connect Config Validator The mistakes that raise no error Kafka Consumer Group Id Validator Which broker coordinates the group Kafka Partition Assignment Visualizer Leadership is the load, not replicas Kafka ZooKeeper to KRaft Config Converter The authorizer class nobody changes Kafka Config to Strimzi Half of it belongs elsewhere Kafka Docker Compose Generator (KRaft) Reachable from inside and outside Kafka JAAS Config Decoder The line that stops SASL working Kafka CRC32C Calculator Which CRC, over which bytes Kafka Config Upgrade Checker What breaks when you upgrade Kafka Kafka Config Diff Which change actually changed something Kafka Consumer Config Linter Why the group rebalances, and where the records went Kafka Avro Schema Validator The defaults Avro accepts and rejects Kafka Schema Compatibility Checker What the registry will say, before you ask it Kafka Avro Schema Diff Which direction each change breaks Kafka Compression Comparison Measured on your bytes Kafka Delivery Semantics Exactly-once has a consumer half Kafka ksqlDB Query Builder It looks like SQL and the rules are not Kafka Connect SMT Predicate Tester negate reads backwards Kafka Streams Topology Viewer Count the repartitions Kafka Connect Pipeline Visualizer The order things really run in Kafka Protobuf Binary Decoder Works without the .proto Kafka Protobuf JSON Converter Why your JSON does not round-trip Kafka Protobuf to Avro Schema What does not survive the conversion Kafka Avro Binary Decoder Wrong schema, no error Kafka Avro JSON Converter Why the console producer rejects your line Kafka Avro Sample Data Generator Records that actually serialize Kafka JSON to Avro Schema What JSON cannot tell you Kafka JSON Schema to Avro What does not survive the conversion Kafka SASL JAAS Generator One login module, four syntaxes Kafka CLI Command Builder kcat is librdkafka, not Kafka

Elsewhere on the site