benchmark-integrity
Everything on Ground Truth tagged “benchmark-integrity” — 1 item.
Basalt Labs' 'Best AI Model' Claim Collapses: Its Own Repo Admits Monolith-1.0 Was a Relabeled 7B Model News
Basalt Labs claimed its Monolith-1.0 model scored 99.4% on Humanity's Last Exam and was a 1.57-trillion-parameter system, but its own Hugging Face model card now says the publicly released model was an inflated version of the much smaller Qwen 2.5 7B Instruct, and the weights have been pulled.