Kafka Timestamp Converter

Convert Kafka record timestamps, one per line, from whichever unit you have. Kafka stores milliseconds; the report says how each input was read, because a bare number is ambiguous between four units.

Detection uses the digit count, which is the only signal a bare integer carries. A seconds value read as milliseconds lands in 1970, which reads as a plausible bug rather than an impossible date, so it is the direction worth stating the unit for.

Paste below, or drop a file anywhere on this panel

Or drop a file anywhere on this panel. Nothing is uploaded: the analysis runs in this tab.

The answer appears here

Paste on the left and press Convert. Nothing leaves this tab.

Examples

Real input you can load into the tool above. Each one shows a different thing going wrong, because that is what the tool is for.

The -1 sentinel

Kafka's no-timestamp value, which is not a date and must not be converted as one

1700000000000
1700000000
-1

Four possible units

The same digits read as seconds, milliseconds, microseconds and nanoseconds

1700000000000000

Common mistakes

These are the ones that fail silently. The config is accepted, nothing raises an error, and the consequence arrives later.

  1. Converting -1 as a date

    It is Kafka's sentinel for no timestamp, and it is also what offsetsForTimes returns when no record matches.

    Instead:Treat it as a sentinel. Converting gives December 1969.

  2. Reading seconds as milliseconds

    The result lands in 1970, which looks like an uninitialised value and gets investigated as a bug.

    Instead:Count the digits. Thirteen is milliseconds.

  3. Assuming a record timestamp is the event time

    With the default CreateTime it is whatever the producer set, which can be wrong or in the future. With LogAppendTime the broker overwrites it.

    Instead:Check message.timestamp.type on the topic before trusting it.

A Kafka timestamp is milliseconds, and means one of two things

The unit is only ambiguous on the way in. The meaning is ambiguous permanently, and it depends on a topic setting rather than on anything in the record.

Kafka stores milliseconds, always

Every record timestamp in every message format is milliseconds since the Unix epoch. The ambiguity is entirely in what you have in front of you: a bare integer could be seconds from a log line, milliseconds from Kafka itself, microseconds from a database or nanoseconds from a tracing system, and the digit count is the only available signal.

Seconds read as milliseconds lands in 1970

This is the dangerous direction. 1700000000 read as milliseconds is January 1970, which looks like an uninitialised value or a plausible bug, so it gets investigated as one. The reverse mistake puts the date somewhere around the year 56,000, which is at least obviously wrong and gets fixed in seconds. That asymmetry is why the reading is always reported here rather than assumed.

CreateTime and LogAppendTime are completely different fields

With message.timestamp.type=CreateTime, the default, the timestamp is whatever the producer put there. It can be in the future, it can be wrong, and it is not monotonic across a partition, because two producers do not share a clock. With LogAppendTime the broker overwrites it on append, which makes it monotonic and reliable and destroys the producer's own event time. Neither is better; they answer different questions.

A topic can hold both

Switching message.timestamp.type does not rewrite existing records, so a topic that changed at some point holds records written under each. Anything that assumes one meaning across a whole partition is wrong for the records on the other side of that change, and there is nothing in the record to say which it was.

What this cannot see

It cannot tell you which timestamp type a topic uses, because that is a topic config rather than anything in a timestamp. -1 is Kafka's sentinel for no timestamp and is reported as a sentinel rather than converted, and it is also what offsetsForTimes returns for a partition with no matching record. For the general case outside Kafka, the Unix timestamp converter on this site handles the same units without the Kafka specifics.

More kafka tools

Kafka Confluent Wire Format Decoder The five junk bytes in front of your payload Kafka Key to Partition Mapper Which partition does this key land on? Kafka Topic Name Validator Legal, risky, or 249 characters too long? Kafka Replication Safety Checker How many brokers can you lose Kafka Producer Config Linter Will it start, and will it lose a record? Kafka Message Payload Decoder The first five bytes are usually not data Kafka Connect Source Connector Generator tasks.max is a ceiling, not a count Kafka Connect Sink Connector Generator A dead letter queue with no context headers is a pile of records Kafka Connect SMT Chain Builder The order is the transforms list Kafka MirrorMaker 2 Config Generator It renames every topic by default Kafka Partition Reassignment Generator The throttle is not optional Strimzi Kafka Resource Generator Without the cluster label, nothing happens Kafka mTLS Config Generator The certificate is the identity Kafka Schema Registry Config Generator The compatibility direction is your deployment order Kafka Exactly-Once Config Generator Half of it is worse than none Kafka Broker and KRaft Config Generator The internal topics that break a one-broker cluster Kafka Quota Generator Byte rates are per broker, not per cluster Kafka Streams Config Generator application.id is four things at once Kafka Connect Worker Config Generator Security three times, or the tasks fail Kafka Retention and Unit Converter log.retention.hours does not take milliseconds Kafka .properties to YAML Converter Dotted keys stay flat Kafka Streams Internal Topic Predictor Create them before Streams does Kafka ACL Generator The grant you forgot is on another resource type Kafka Topic Config Generator min.insync.replicas is the one that matters Kafka client.properties Generator The file every CLI tool asks for Kafka Producer Config Generator No password field, on purpose Kafka Consumer Config Generator The commit mode decides the semantics Kafka Disk and Retention Calculator retention.bytes is per partition Kafka Partition Count Calculator The number you can never reduce Kafka Cluster Sizing Calculator The traffic no client metric shows Kafka Consumer Lag Catch-Up Calculator Whether it ever clears, not just when Kafka Producer Batching Calculator linger.ms=0 still batches Kafka Segment and Index Sizing Why retention.ms is a lower bound Kafka Rebalance Duration Estimator What a rolling restart really costs Kafka Cost Estimator Your rates, so nothing goes stale Kafka Config Explorer by Version The answer depends on the release Kafka Default Config Reference What moved under a config you never edited Kafka OAuth Bearer Token Decoder Will Kafka accept it, and can it refresh Kafka Record Header Viewer Headers are a list, not a map Kafka Topic Regex Subscription Tester Kafka matches the whole name Kafka ACL Permission Matrix Viewer DENY beats every ALLOW Kafka Connect Config Validator The mistakes that raise no error Kafka Consumer Group Id Validator Which broker coordinates the group Kafka Partition Assignment Visualizer Leadership is the load, not replicas Kafka Consumer Assignment Visualizer The three assignors disagree Kafka ZooKeeper to KRaft Config Converter The authorizer class nobody changes Kafka Config to Strimzi Half of it belongs elsewhere Kafka Docker Compose Generator (KRaft) Reachable from inside and outside Kafka JAAS Config Decoder The line that stops SASL working Kafka CRC32C Calculator Which CRC, over which bytes Kafka Config Upgrade Checker What breaks when you upgrade Kafka Kafka Config Diff Which change actually changed something Kafka Consumer Config Linter Why the group rebalances, and where the records went Kafka Avro Schema Validator The defaults Avro accepts and rejects Kafka Schema Compatibility Checker What the registry will say, before you ask it Kafka Avro Schema Diff Which direction each change breaks Kafka Compression Comparison Measured on your bytes Kafka Delivery Semantics Exactly-once has a consumer half Kafka ksqlDB Query Builder It looks like SQL and the rules are not Kafka Connect SMT Predicate Tester negate reads backwards Kafka Streams Topology Viewer Count the repartitions Kafka Connect Pipeline Visualizer The order things really run in Kafka Protobuf Binary Decoder Works without the .proto Kafka Protobuf JSON Converter Why your JSON does not round-trip Kafka Protobuf to Avro Schema What does not survive the conversion Kafka Avro Binary Decoder Wrong schema, no error Kafka Avro JSON Converter Why the console producer rejects your line Kafka Avro Sample Data Generator Records that actually serialize Kafka JSON to Avro Schema What JSON cannot tell you Kafka JSON Schema to Avro What does not survive the conversion Kafka SASL JAAS Generator One login module, four syntaxes Kafka CLI Command Builder kcat is librdkafka, not Kafka

Elsewhere on the site