logit-lens

The Logit Lens: Reading a Model's Guesses Before It Finishes Thinking Lesson

The logit lens is an interpretability technique that decodes a language model's partial, mid-computation representations into vocabulary words, letting researchers watch the model's best guess evolve layer by layer before it produces a final answer.