low-latency
Everything on Ground Truth tagged “low-latency” — 2 items.
Mercury 2 (Inception Labs) Tool
An API-only diffusion language model pitched on raw speed, claiming to out-pace open diffusion models on tokens-per-second for latency-sensitive generation.
AuK-Flash Tool
The distilled sibling of AuK, generating in four steps instead of the full sampling schedule for markedly faster inference at the same 6.8 GB download size. Same MIT licence and the same instruction interface.