vllm
Kimi K3 is downloadable, but the floor to run it is eight datacenter GPUs News
Kimi K3's 1.56-terabyte checkpoint needs a single eight-GPU B300 or MI355X node as its practical minimum, and no version of llama.cpp can load it today, so open weights currently mean operator-scale rather than local.
vLLM recipe for DeepSeek V4 Flash Tool
An official vLLM recipe page with working launch commands for serving V4 Flash across several hardware configurations, including the flag that turns on the DSpark speculative-decoding module and the FP8 KV-cache and expert-parallel settings DeepSeek recommends.
vLLM Skills Tool
Packaged skills for working with vLLM, published by the vLLM project itself, in the same portable Agent Skills format. Useful if you want an agent that can actually configure and debug a vLLM deployment rather than guessing at flags.
Ling-3.0-flash Tool
inclusionAI's 124B mixture-of-experts model with about 5.1B parameters activated per token. Sparse routing genuinely cuts per-token compute, but this is a server-class artifact, not a laptop one: the BF16 repository is roughly 255GB and the official serving path calls for custom SGLang or vLLM forks with tensor parallelism across four GPUs.