TIThe Inference
Inference & Models·Advanced · 8–16h
Build your own speculative decoding
Draft and verify for a measured speedup, output-identical.
What you'll build
A draft+verify loop, output-identical to the target, with a measured speedup.
Prerequisites