Forward → logits·2 min
Why tie the LM head
0 / 2
Two final checks: how the logits are produced, and the exact order of the last steps.
Knowledge check
After stacking all 12 blocks and applying ln_f, how are the logits produced?
Knowledge check
What is the correct order of the final steps, and when is ln_f applied?