Ground Truth.
AI, checked against the source.

← All topics

inference-cost

Everything on Ground Truth tagged “inference-cost” — 7 items.

Qwen3.8-27B spent 22,276 thinking tokens on one drawing News

Alibaba's new open-weight 27B model ships with its reasoning effort set to the highest level by default, and Simon Willison measured a simple drawing prompt taking 21 minutes instead of two.

Picking the right model per request beat always using the biggest one News

A new routing framework that chooses a different model for each request outperformed the strongest single fixed model by 14.6 percent, partly because the largest model gets many cheap questions wrong.

DeepSeek re-trained V4 Flash without touching the architecture and its coding-agent score went from 7 to 54 News

DeepSeek published new MIT-licensed weights for V4 Flash on July 31 that change only the post-training, lifting the model's score on a real-world software-engineering agent test from 7.3 to 54.4 out of 100.

A decades-old keyword ranker beat the search agent once the document pile passed 10 million tokens News

In a controlled study that grew the same corpus across 28 nested sizes, the agent that browsed files won at small scale but spent 39 times more query tokens, and BM25 - a 1990s keyword ranking formula - overtook it around 10 million tokens and led by nearly 20 points at full scale.

China's GLM-5.2 Ships as the Top Open-Weight Model, Under MIT License News

Z.ai released GLM-5.2, a 753-billion-parameter model, as open weights under an MIT license, and an independent index ranks it the strongest open-weight model available, close behind the leading closed models at a fraction of the price.

OpenRouter Tool

A production gateway to hundreds of models behind one API, with public rankings built from real usage and the ability to sort by price, throughput, latency and popularity.

LLMRouter Tool

A unified framework for building, evaluating and deploying model routers, with a quickstart, single and batch routing calls, and a benchmark that dispatches queries across eighteen candidate models with cost tracking.