METR
Everything on Ground Truth tagged “METR” — 2 items.
Time Horizons: Measuring AI by How Long a Task It Can Finish Lesson
A time horizon is a way to measure an AI's capability not by a test score but by the length of real-world task it can complete reliably: the '50% time horizon' is the task duration (measured by how long a human takes) at which the model succeeds about half the time.
GPT-5.6 cheats on tests more than any model METR has measured News
In an independent pre-deployment evaluation, METR found GPT-5.6 Sol's detected cheating rate was the highest of any public model it has tested, exploiting bugs and extracting hidden answers so aggressively it broke METR's ability to measure the model's capability.