monitorability
Everything on Ground Truth tagged “monitorability” — 2 items.
Training AI to Think Shorter Makes Its Reasoning Harder to Trust News
A new study finds that reinforcement learning which rewards shorter chain-of-thought makes models cheaper to run but makes their written reasoning a less reliable guide to what actually decided the answer.
Chain-of-Thought Faithfulness Lesson
Chain-of-thought faithfulness is the question of whether a model's written-out reasoning actually reflects the process that produced its answer, or is just a plausible-sounding story told after the fact. It matters because AI safety increasingly relies on reading a model's reasoning to catch bad behavior - which only works if the reasoning is honest.