Prefilling the prompt·2 min
What does prefill leave behind?
0 / 1
Knowledge check
After prefilling a 10-token prompt, what's in the cache and what's the next token's position?
Build your own KV cache
After prefilling a 10-token prompt, what's in the cache and what's the next token's position?