consumer-hardware
Everything on Ground Truth tagged “consumer-hardware” — 1 item.
A 753 billion parameter model ran on a single workstation GPU News
A serving system called FreeToken reports running frontier-scale sparse models on ordinary personal hardware, including a 753 billion parameter model on one workstation GPU and a 35 billion parameter model on a laptop with 8 gigabytes of video memory.