Ground Truth.
AI, checked against the source.

← All topics

local-inference

Everything on Ground Truth tagged “local-inference” — 4 items.

Poolside's Laguna S 2.1 is a small open coding agent with big benchmark claims News

Poolside released Laguna S 2.1, a public-weight coding model with an unusually low 8 billion active parameters that runs locally on a single high-end machine, but its claims of beating DeepSeek V4 Pro come from the company's own benchmark table and one early hands-on tester found it fabricates facts when evidence runs out.

Nanbeige4.2-3B reuses one 22-layer stack twice to punch above its size News

A Chinese lab released Nanbeige4.2-3B, a small open-weight model that runs its 22 transformer layers twice in sequence to get 44 layers of depth from one set of weights, posting benchmark numbers rivaling models three times its size, though the results are vendor-reported and a widely repeated 'beats 4x its size' claim does not survive clean accounting.

Poolside Laguna S 2.1 Tool

A public-weight, 118B-total mixture-of-experts coding model with only ~8B active parameters that runs locally on a single 128GB machine via a 75GB Q4 GGUF, built for long-horizon agentic software work under the permissive OpenMDW-1.1 license.

Nanbeige4.2-3B Tool

An Apache-2.0 4B model that reuses one 22-layer transformer stack twice for 44 layers of depth from a single set of weights, shipping BF16 weights with SGLang, vLLM, llama.cpp, and Ollama paths for local use.