mamba
Everything on Ground Truth tagged “mamba” — 2 items.
State Space Models and Mamba Lesson
State space models are a transformer alternative that processes a sequence by carrying a fixed-size running summary forward one step at a time, giving them linear cost with length and constant memory per token -- which is why models like Mamba can handle very long inputs cheaply.
Nvidia's 'Puzzle' pipeline shrinks a 120B model to 75B and roughly doubles serving throughput News
Nvidia's Nemotron-3-Puzzle compresses a 120-billion-parameter model down to 75 billion using a multi-stage pipeline of pruning, distillation, and quantization -- roughly doubling throughput on a B200 node and lifting single-H100 concurrency at long context from one request to eight.