Setup & the O(n²) wall·2 min
Why cache at all?
0 / 1
Knowledge check
Generating the whole length-n sequence by recomputing every step costs ___, while cached decode costs ___.
Build your own KV cache
Generating the whole length-n sequence by recomputing every step costs ___, while cached decode costs ___.