independent-research
Everything on Ground Truth tagged “independent-research” — 1 item.
One engineer trained a 3.8-billion-parameter model for $998 News
Hugo Vergnes trained a 3.8-billion-parameter language model from random weights to a score beating GPT-2 in 43 hours on eight rented GPUs, for a total cloud bill of $998, and published the full recipe including the optimiser, data mix and precision choices that made it affordable.