self-host
Everything on Ground Truth tagged “self-host” — 2 items.
Mesh LLM Tool
Runs models too big for one machine by splitting them across networked peers over serverless peer-to-peer transport; ~18 MB install, 40+ models up to 235B, OpenAI-compatible API on localhost.
DiffusionGemma Tool
Google's open-weight text-diffusion model that generates text in parallel blocks instead of one token at a time; Apache-2.0, runnable locally, with community tooling already shipping.