llm
Chat templates: the invisible tags that tell a model who is speaking Lesson
A language model never sees a conversation - it sees one long string, and small marker tokens are the only thing telling it which parts are your instructions, which are its own thoughts, and which are untrusted data from the outside world.
A New Benchmark Asks Whether a Coding Agent Can Stop Asking News
CAPA tests whether an assistant that has watched one developer resolve the same ambiguity before can write the intended code without asking again, and finds that the best model still needs a clarification round on four sessions in ten.
The RL 'mirage': the policy you optimize isn't the one you ship News
A top-ranked paper shows that in modern RL training, improving the model you optimize does not guarantee improving the model you actually deploy - because the two run on different engines that disagree on probabilities.
A 32B model reaches frontier level by learning what to remember News
New research reframes agent memory as a trainable skill rather than a growing transcript - and shows that optimizing memory alone lets a 32B open model rival Claude Opus, and a 4B model leap from 4% to 78% on a benchmark.
Qwen3.8-Max Tool
Alibaba's new flagship multimodal model, live today as a paid API at $2 per million input tokens and $6 per million output tokens, with a one-million-token context, function calling, structured output, and prompt caching that drops repeated input to $0.25 per million. Weights are promised but not published.
Qwen3.6-35B-A3B Tool
Alibaba's open-weight agentic-coding model (35B total / 3B active, Apache 2.0) with 262K native context extensible toward 1M tokens, hybrid Gated-DeltaNet + MoE attention, thinking preservation across turns, and built-in tool use. Downloadable and self-hostable on common open serving stacks.
Qwen3.6 (open weights) Tool
Alibaba's stable Qwen3.6 release: open-weight general chat and coding models you can self-host, the same family at the center of this week's open-vs-closed pricing debate.
Qwen3-Next-80B-A3B-Instruct Tool
Alibaba's efficiency-focused open-weight model (80B total / 3B active, 512 experts) with 262K native context to ~1M, built around hybrid attention, high-sparsity MoE, and multi-token prediction; the model card claims roughly 10x inference throughput past 32K context versus a dense 32B baseline.
Poolside Laguna S 2.1 Tool
A public-weight, 118B-total mixture-of-experts coding model with only ~8B active parameters that runs locally on a single 128GB machine via a 75GB Q4 GGUF, built for long-horizon agentic software work under the permissive OpenMDW-1.1 license.
Nanbeige4.2-3B Tool
An Apache-2.0 4B model that reuses one 22-layer transformer stack twice for 44 layers of depth from a single set of weights, shipping BF16 weights with SGLang, vLLM, llama.cpp, and Ollama paths for local use.
Muse Spark 1.1 Tool
Meta Superintelligence Labs' multimodal reasoning model built for agentic work - tool and computer use, coding, a 1M-token context window, and subagent orchestration; live in the Meta AI app's Thinking mode and on meta.ai, with a Meta Model API in public preview.
Mercury 2 (Inception Labs) Tool
An API-only diffusion language model pitched on raw speed, claiming to out-pace open diffusion models on tokens-per-second for latency-sensitive generation.
Ling-3.0-flash (free API) Tool
Ant's 124B-parameter mixture-of-experts model that activates only 5.1B parameters per token, with a 256K context and OpenAI- and Anthropic-compatible endpoints. Currently free on OpenRouter as inclusionai/ling-3.0-flash:free; aimed at long-horizon agent workflows and tool calling.
Kimi K3 Tool
Moonshot AI's 2.8-trillion-parameter flagship with a 1M-token context window, tuned for agentic coding and knowledge work; it topped a frontend-coding leaderboard. Usable now via kimi.com chat and an OpenAI-compatible API, with open weights due July 27.
Kimi K2.7 Code Tool
Moonshot AI's trillion-parameter mixture-of-experts coding agent, with only 32B active per token, a 256K context, and vision input, now selectable inside GitHub Copilot and downloadable under a Modified MIT license.
Gemini 3.6 Flash Tool
Google's newly GA fast model streams output nearly twice as fast as 3.5 Flash and costs less per task while holding the same intelligence-index score, tuned for high-volume agent loops that use fewer tokens and tool calls.
GLM-5.2 on Baseten Tool
The top trending open-weight model served as a fast hosted endpoint, reported at 280+ tokens/sec on Blackwell-class hardware -- an open model you can call like a closed one.
GLM-5.2 Tool
A flagship openly-available language model with a very large context window for long documents and code. Free to download and run yourself, with compressed versions for more modest hardware.
GLM 5.2 (GGUF, runnable locally) Tool
Zhipu AI's open, MIT-licensed mixture-of-experts model with a roughly million-token context, now packaged as ready-to-run quantized files you can host on your own machine. Strong on agent and coding workflows; this week it beat Claude on a narrow security benchmark at a fraction of the cost.
DeepSeek-V4-Flash Tool
MIT-licensed weights for DeepSeek's 284B-total / 13B-active mixture-of-experts model with a one-million-token context, with vLLM and SGLang serving examples on the model card. Real hardware bar: the reference recipe targets four B200 or B300 GPUs.
DeepSeek-V4 (Pro & Flash) Tool
Two newly previewed open-weight models with a 1-million-token context window on by default - a large mixture-of-experts flagship and a smaller, fast everyday model. Downloadable weights plus an API.
DeepSeek V4 Pro (API) Tool
A strong open-weight reasoning and coding model now offered through DeepSeek's own API at a permanently cut, low per-token price, undercutting frontier closed models for high-volume work.
DeepSeek V4 Flash 0731 (API) Tool
The updated V4 Flash checkpoint now serves behind the existing deepseek-v4-flash identifier, with a 1-million-token context, 384K maximum output, tool calls, and an OpenAI-, Anthropic- and Responses-API-compatible interface. Fresh input runs $0.14 per million tokens, output $0.28, and cached input $0.0028 - a fiftyfold discount on repeated prefixes.
DeepSeek V4 Tool
DeepSeek's latest model family (a 1.6T-parameter Pro and a 284B Flash, both with a 1-million-token context by default), available as an API and as open weights on Hugging Face.