local-models
Everything on Ground Truth tagged “local-models” — 3 items.
jlens-gguf Tool
A GGUF-native implementation of Anthropic's Jacobian Lens for local models, with a browser UI to visualize, swap, and ablate a model's internal concepts live as it generates through llama.cpp.
Voodoo Quant Tool
A per-tensor sensitivity-aware quantization method that spends more bits on important tensors, claiming large divergence reductions over standard llama.cpp and Unsloth quants, especially at 1-bit and 2-bit; GGUF files run in unmodified llama.cpp.
OpenCode Tool
An open coding agent shown this week to send a fraction of the fixed token overhead of some rivals, with a stable prompt-cache prefix; works against frontier and local models alike.