precision
Everything on Ground Truth tagged “precision” — 1 item.
Mixed-precision training: why models are trained in half-broken numbers on purpose Lesson
Modern models are trained using 16-bit and even 8-bit numbers instead of the 32-bit standard, roughly doubling speed and halving memory, by carefully keeping full precision exactly where the arithmetic would otherwise fall apart.