Kafka Avro Schema Validator

Check an Avro schema, with the exact path to what is wrong. Then the part a parser will not tell you: the union default on the wrong branch, the enum with no fallback, and the logical type that is quietly ignored.

Paste below, or drop a file anywhere on this panel

Or drop a file anywhere on this panel. Nothing is uploaded: the analysis runs in this tab.

The answer appears here

Paste on the left and press Validate. Nothing leaves this tab.

Examples

Real input you can load into the tool above. Each one shows a different thing going wrong, because that is what the tool is for.

A default that does not match the union

A default must match the FIRST branch of a union, so this schema is invalid

{"type":"record","name":"U","fields":[{"name":"x","type":["null","string"],"default":"a"}]}

A field with no default

What blocks a backward-compatible schema evolution later

{"type":"record","name":"User","fields":[{"name":"id","type":"string"}]}

Common mistakes

These are the ones that fail silently. The config is accepted, nothing raises an error, and the consequence arrives later.

  1. Giving a union a default that does not match its first branch

    Avro requires the default to match the FIRST type in the union. ["null","string"] must default to null, not to a string.

    Instead:Order the union so the default type comes first, usually null.

  2. Adding a field with no default

    A reader using the old schema cannot supply a value, so the change is not backward compatible and the registry rejects it.

    Instead:Give every new field a default, and null with a null union is the usual choice.

  3. Renaming a field

    Avro matches fields by name, so a rename is a delete plus an add. Old data loses the value entirely.

    Instead:Add an alias instead, which Avro resolves during schema resolution.

What Avro accepts that will still ruin your afternoon

Every schema on this page parses. What is reported is what happens next: at the registry, at the next version, or at the consumer that was never redeployed.

A union default belongs to the first branch, and only the first

This is the most common mistake in Avro and it is silent for years. A default value for a union field has to be a value of the union's first branch, so ["null", "string"] takes a default of null and nothing else, and ["string", "null"] takes a string. Avro's Java parser has validated this by default since 1.9, so the same schema is accepted by an older toolchain and rejected by a current one. That is how it reaches production before it fails.

{"name": "note",
 "type": ["null", "string"],
 "default": ""}
// rejected: "" is a string and the
// first branch is null

A field with no default can never be added later

A reader fills a field the writer did not have from that field's default. Without one, the field can only be read from data written by a schema that also had it, so adding it to a registered schema is a backward-incompatible change and the registry rejects the version under the default BACKWARD policy. For a first version this is entirely normal, which is why it is reported here once and as information rather than as a warning per field.

An enum with no default breaks the day you add a symbol

A consumer on the old schema meets a value it has no symbol for and the deserializer throws. Avro 1.9 added an enum default for exactly this, and it only helps if it is already in the schema those consumers are running: adding a default at the same time as the new symbol helps nobody. If the set of values is genuinely open, a string field is the honest answer.

{"type": "enum",
 "name": "Status",
 "symbols": ["NEW", "DONE"],
 "default": "NEW"}

An invalid logical type is ignored, not rejected

That is the specified behaviour rather than a bug. A logicalType Avro does not recognise, or one on the wrong underlying type, is dropped and the field is read as the plain type underneath. timestamp-millis on an int is the usual instance: it is silently ignored, and an int would overflow 24 days into 1970 anyway. Nothing at any stage reports it, which is why it is checked here.

The fingerprint, and what it deliberately ignores

The panel shows Avro's CRC-64-AVRO fingerprint over the parsing canonical form. Two schemas with the same fingerprint are the same schema to a reader, however differently they are written: namespaces are folded into names, primitives are reduced to their bare form, and documentation, aliases, defaults and logical types are stripped. So a schema that only adds documentation has an identical fingerprint, and so does one that only changes a default. It is not the Schema Registry's id, which is a sequence number the registry assigns and cannot be computed from a schema.

What this cannot see

Whether the schema is registered, what version it would be, and whether it is compatible with what is already there. The compatibility checker on this site answers the last one for a chosen level, and it needs both schemas. This page also does not validate data against the schema: the Avro binary decoder and the JSON converter do that.

More kafka tools

Kafka Confluent Wire Format Decoder The five junk bytes in front of your payload Kafka Key to Partition Mapper Which partition does this key land on? Kafka Topic Name Validator Legal, risky, or 249 characters too long? Kafka Replication Safety Checker How many brokers can you lose Kafka Producer Config Linter Will it start, and will it lose a record? Kafka Message Payload Decoder The first five bytes are usually not data Kafka Connect Source Connector Generator tasks.max is a ceiling, not a count Kafka Connect Sink Connector Generator A dead letter queue with no context headers is a pile of records Kafka Connect SMT Chain Builder The order is the transforms list Kafka MirrorMaker 2 Config Generator It renames every topic by default Kafka Partition Reassignment Generator The throttle is not optional Strimzi Kafka Resource Generator Without the cluster label, nothing happens Kafka mTLS Config Generator The certificate is the identity Kafka Schema Registry Config Generator The compatibility direction is your deployment order Kafka Exactly-Once Config Generator Half of it is worse than none Kafka Broker and KRaft Config Generator The internal topics that break a one-broker cluster Kafka Quota Generator Byte rates are per broker, not per cluster Kafka Streams Config Generator application.id is four things at once Kafka Connect Worker Config Generator Security three times, or the tasks fail Kafka Retention and Unit Converter log.retention.hours does not take milliseconds Kafka Timestamp Converter Two sentinels and two meanings Kafka .properties to YAML Converter Dotted keys stay flat Kafka Streams Internal Topic Predictor Create them before Streams does Kafka ACL Generator The grant you forgot is on another resource type Kafka Topic Config Generator min.insync.replicas is the one that matters Kafka client.properties Generator The file every CLI tool asks for Kafka Producer Config Generator No password field, on purpose Kafka Consumer Config Generator The commit mode decides the semantics Kafka Disk and Retention Calculator retention.bytes is per partition Kafka Partition Count Calculator The number you can never reduce Kafka Cluster Sizing Calculator The traffic no client metric shows Kafka Consumer Lag Catch-Up Calculator Whether it ever clears, not just when Kafka Producer Batching Calculator linger.ms=0 still batches Kafka Segment and Index Sizing Why retention.ms is a lower bound Kafka Rebalance Duration Estimator What a rolling restart really costs Kafka Cost Estimator Your rates, so nothing goes stale Kafka Config Explorer by Version The answer depends on the release Kafka Default Config Reference What moved under a config you never edited Kafka OAuth Bearer Token Decoder Will Kafka accept it, and can it refresh Kafka Record Header Viewer Headers are a list, not a map Kafka Topic Regex Subscription Tester Kafka matches the whole name Kafka ACL Permission Matrix Viewer DENY beats every ALLOW Kafka Connect Config Validator The mistakes that raise no error Kafka Consumer Group Id Validator Which broker coordinates the group Kafka Partition Assignment Visualizer Leadership is the load, not replicas Kafka Consumer Assignment Visualizer The three assignors disagree Kafka ZooKeeper to KRaft Config Converter The authorizer class nobody changes Kafka Config to Strimzi Half of it belongs elsewhere Kafka Docker Compose Generator (KRaft) Reachable from inside and outside Kafka JAAS Config Decoder The line that stops SASL working Kafka CRC32C Calculator Which CRC, over which bytes Kafka Config Upgrade Checker What breaks when you upgrade Kafka Kafka Config Diff Which change actually changed something Kafka Consumer Config Linter Why the group rebalances, and where the records went Kafka Schema Compatibility Checker What the registry will say, before you ask it Kafka Avro Schema Diff Which direction each change breaks Kafka Compression Comparison Measured on your bytes Kafka Delivery Semantics Exactly-once has a consumer half Kafka ksqlDB Query Builder It looks like SQL and the rules are not Kafka Connect SMT Predicate Tester negate reads backwards Kafka Streams Topology Viewer Count the repartitions Kafka Connect Pipeline Visualizer The order things really run in Kafka Protobuf Binary Decoder Works without the .proto Kafka Protobuf JSON Converter Why your JSON does not round-trip Kafka Protobuf to Avro Schema What does not survive the conversion Kafka Avro Binary Decoder Wrong schema, no error Kafka Avro JSON Converter Why the console producer rejects your line Kafka Avro Sample Data Generator Records that actually serialize Kafka JSON to Avro Schema What JSON cannot tell you Kafka JSON Schema to Avro What does not survive the conversion Kafka SASL JAAS Generator One login module, four syntaxes Kafka CLI Command Builder kcat is librdkafka, not Kafka

Elsewhere on the site