Ground Truth.
AI, checked against the source.

← All topics

local-models

Everything on Ground Truth tagged “local-models” — 10 items.

Qwen3.8-27B spent 22,276 thinking tokens on one drawing News

Alibaba's new open-weight 27B model ships with its reasoning effort set to the highest level by default, and Simon Willison measured a simple drawing prompt taking 21 minutes instead of two.

Qwen3.8-27B shares its predecessor's bones, but not its contract News

Alibaba's Qwen3.8-27B shipped with the same coarse architecture as Qwen3.6-27B, prompting accusations it was a relabel with knowledge stripped out, but the published comparison shows knowledge scores flat or slightly up.

Meta ships a 30B agent model that fits on one gaming GPU News

Meta released Muse Glimmer, a 30-billion-parameter open-weight agent model under the permissive Apache 2.0 license that shrinks to under 20 GB once quantized, small enough to run on a single 24 GB consumer graphics card.

jlens-gguf Tool

A GGUF-native implementation of Anthropic's Jacobian Lens for local models, with a browser UI to visualize, swap, and ablate a model's internal concepts live as it generates through llama.cpp.

Voodoo Quant Tool

A per-tensor sensitivity-aware quantization method that spends more bits on important tensors, claiming large divergence reductions over standard llama.cpp and Unsloth quants, especially at 1-bit and 2-bit; GGUF files run in unmodified llama.cpp.

Unsloth Qwen3.8-27B GGUF Tool

Quantized builds of Alibaba's newest 27B open-weight model, published within minutes of the release, in a range of sizes that fit on a single consumer graphics card.

Qwen3.8-27B Tool

Apache 2.0 vision-capable 27B model with a 262k context window, runnable on a well-specced laptop in quantized form. Ships with reasoning effort set to xhigh, which is worth turning down before first use.

OpenCode Tool

An open coding agent shown this week to send a fraction of the fixed token overhead of some rivals, with a stable prompt-cache prefix; works against frontier and local models alike.

Muse Glimmer 30B GGUF (Unsloth) Tool

Community-packaged quantized builds of Muse Glimmer that fit under 20 GB, with setup instructions for llama.cpp, Ollama, vLLM, and SGLang. This is the practical path if you want the model running on a single 24 GB consumer graphics card rather than compiling the full-precision weights yourself.

Muse Glimmer 30B Tool

Meta's 30-billion-parameter open-weight agent model under Apache 2.0, built for always-on local workflows with text and image input, tool use, a context window past 131,000 tokens, and a speculative decoder that drafts sixteen words at a time. Full weights, quantized builds, and the drafter are all in the release.