looped-transformers
Everything on Ground Truth tagged “looped-transformers” — 1 item.
Looping half a model's layers twice beat making the model bigger News
A paper posted September 1, 2026 ran the first compute-matched test of looped mixture-of-experts transformers and found that re-running the middle half of the layers a second time saves compute at the frontier, with savings growing as budgets grow.