AI infrastructure tools

The bytes on the wire, the schema the API accepts, and what it costs.

LLM SSE Stream Decoder

Reassemble the message from the wire

Decode a raw LLM SSE stream from the Anthropic or OpenAI API, reassemble the message, and see exactly where a truncated response stopped.

LLM Tool Definition Converter

Anthropic, OpenAI and MCP, both ways

Convert an LLM tool definition between Anthropic, OpenAI and MCP formats, with the fields that have no equivalent named rather than dropped.

LLM JSON Schema Strict Mode Checker

What structured output will refuse

Check whether an LLM JSON schema survives strict structured output: recursion, minimum and maxLength are rejected, additionalProperties must be false.

LLM Context Window Planner

Where the budget runs out

Plan an LLM context window budget across system prompt, tools, history and output, and find where max_tokens truncates the answer instead of the input.

LLM Prompt Caching Planner

Where to put the breakpoint

Plan LLM prompt caching breakpoints and get the break-even read count: cache writes cost 1.25x at five minutes and 2x at one hour, reads cost 0.1x.

LLM API Cost Calculator

The number that matches the invoice

Calculate LLM API cost from your own token volumes and rates, including cache reads and writes, so the number matches the invoice rather than a guess.

LLM Model Cost Comparison

Two models, one workload, your rates

Compare LLM model cost side by side across Anthropic, OpenAI, Google and more, with your own rates overriding the table on either side.

LLM API Rate Limit Planner

Which limit you hit first

Plan around LLM API rate limits: what your request shape costs in tokens per minute, and which of RPM, input TPM or output TPM you hit first.

Other categories