TIThe Inference
Inference & Models·Core · 4–8h
Build your own sampler
Turn logits into text — greedy, temperature, top-k, top-p.
What you'll build
A seeded-exact sampler with temperature/top-k/top-p/repetition penalty.
Prerequisites
Turn logits into text — greedy, temperature, top-k, top-p.
What you'll build
A seeded-exact sampler with temperature/top-k/top-p/repetition penalty.
Prerequisites