llama-cpp
Everything on Ground Truth tagged “llama-cpp” — 3 items.
jlens-gguf Tool
A GGUF-native implementation of Anthropic's Jacobian Lens for local models, with a browser UI to visualize, swap, and ablate a model's internal concepts live as it generates through llama.cpp.
Voodoo Quant Tool
A per-tensor sensitivity-aware quantization method that spends more bits on important tensors, claiming large divergence reductions over standard llama.cpp and Unsloth quants, especially at 1-bit and 2-bit; GGUF files run in unmodified llama.cpp.
CachyLLama Tool
MIT-licensed llama.cpp fork that saves conversation and system-prompt caches to SSD and restores them after a restart, so local agents stop reprocessing the same prompt prefix every turn. Its own benchmark reports long repeated agent prefixes going from minutes cold to about a second warm.