News · 2026-09-12

Agnes 3.0 Flash's open weights are a 33B preview, not the model behind its leaderboard score

Agnes AI released the weights of a 33-billion-parameter multimodal model called Agnes 3.0 Flash on Hugging Face on 11 September 2026 under the permissive Apache 2.0 licence. A day later the company rewrote the model card to make clear that these weights are "an earlier open-weight Preview checkpoint," distinct from the production model listed on the Artificial Analysis leaderboard, whose benchmark results "should not be attributed to the Preview weights released here."

Key facts

• 66 GB download: the bf16 weights total 66.18 GB, and the model card recommends a single NVIDIA H200 (141 GB) or H100 (80 GB) GPU.
• When: the repository was created on 11 September 2026 and the card was clarified on 12 September.
• Who: Agnes AI, which Artificial Analysis lists under the maker name Sapiens AI and one trade publication describes as the brand of Singapore-based Sapiens AI.
• Primary source: the Agnes-3.0-Flash model card.

Two models with one name

The release landed on r/LocalLLaMA, the main forum for people who run models on their own hardware, under a title advertising an Artificial Analysis Intelligence Index score of 36. That score is real, but it belongs to a different model.

The Artificial Analysis page for Agnes 3.0 Flash lists it as a "Proprietary model," and it is the version served through Agnes AI's API. The company's own card now draws the line plainly: "The Preview release has 33B parameters and a context window of 262,144 tokens. The production/API model uses a different checkpoint and configuration, with a 1M-token context window."

It is a small release-note correction with a large lesson. A model name is not a model. Before trusting a number next to a download link, check which checkpoint it was measured on. Ground Truth's guide to how AI gets benchmarked covers why that matters.

What is actually in the download

The card's own benchmark table is modest. It places the Preview behind Alibaba's open Qwen3.8 27B on four of its five reported tests, and notes that the figures "do not constitute a controlled head-to-head comparison."

The architecture is the more interesting part. According to the repository's configuration, the model has 72 layers: 54 use a "delta-rule recurrent" design and 18 use standard global attention, alternating three to one. Recurrent layers of this kind keep a fixed-size memory instead of a cache that grows with every token, the idea behind linear attention and state space models, which makes long inputs cheaper to process. A 27-layer vision component lets it read images. It requires trusting the repository's own model code to load.

The bf16 weights are a 66 GB download. The card is specific about hardware: "1 × NVIDIA H200 141 GB or NVIDIA H100 80 GB (or equivalent) at bf16," with "128 GB or more recommended" of host memory. For smaller machines, community quantized versions appeared within a day. The GGUF conversion by 0xKitkat offers a Q4_K_M file of 19.75 GB, plus a 0.93 GB vision projector.

Who is Agnes AI?

Little is on the public record. Artificial Analysis names the maker Sapiens AI, and the company's site at agnes-ai.com describes "World-Class AI Models & AI Applications" with a free API. The same Hugging Face organisation also hosts a smaller model fine-tuned from Alibaba's Qwen3-8B base.

Why it matters

The open-weights world moves on screenshots and forum titles, and a leaderboard number attached to the wrong checkpoint can shape thousands of download decisions within hours. Agnes AI corrected its own card quickly, which is the right behaviour. Readers still have to do the last step themselves. For background on what "open" does and does not promise, see what open weights really means.

The caveat

The Preview's benchmark table is self-reported and uncontrolled, and no independent evaluation of the released weights has been published. Details about the company, its training data and the model's lineage are not documented beyond the model card.

Primary source, verified: read the paper →

Ground Truth. (2026, September 12). Agnes 3.0 Flash's open weights are a 33B preview, not the model behind its leaderboard score. Ground Truth. https://groundtruth.day/news/agnes-3-0-flash-open-weights-are-a-preview-not-the-model-on-the-leaderboard.html

@misc{groundtruth:agnes-3-0-flash-open-weights-are-a-preview-not-the-model-on-the-leaderboard,
  title  = {Agnes 3.0 Flash's open weights are a 33B preview, not the model behind its leaderboard score},
  author = {{Ground Truth}},
  year   = {2026},
  month  = {sep},
  url    = {https://groundtruth.day/news/agnes-3-0-flash-open-weights-are-a-preview-not-the-model-on-the-leaderboard.html}
}

Topics: open-weights · model-release · multimodal · benchmarks · linear-attention · apache-2.0