inference-efficiency
Everything on Ground Truth tagged “inference-efficiency” — 1 item.
Multi-Token Prediction: Teaching Models to Look Several Words Ahead Lesson
Multi-token prediction trains a language model to predict several upcoming tokens at once instead of just the next one, giving a richer training signal and a built-in path to faster generation.