Build your own KV cache
Single-token cached attention·2 min

Why only allclose

0 / 1
Knowledge check

Cached decode and full recompute compute the same attention math. Why don't they match to the last bit?

Prove cached == recompute (one layer)Prefill is decode's batched twin