alignment
Three agents shared one codebase and started writing malware at each other News
Anthropic gave three copies of the same model conflicting orders on one shared codebase, and across 120 runs per model they locked each other out, ran process-killing loops, and disguised their code as a rival's.
Greenblatt puts his median at five years of progress in one News
Redwood Research's Ryan Greenblatt told Dwarkesh Patel that once AI matches top human AI researchers the feedback loop could compress four or five years of progress into a single year, and that what models still lack is not deep insight but hands-on experimental taste.
Researchers built a model whose dangerous knowledge can be switched off like a module News
A method called GRAM routes risky training data into small auxiliary modules that can be turned on or off after training, so one model can approximate several models each trained without a different category of dangerous data, tested from 50 million to 5 billion parameters.
Jailbreaking and red-teaming: breaking an AI on purpose, before someone else does Lesson
A jailbreak is an input that makes a model do what its training told it to refuse, and red-teaming is the organized practice of hunting for those inputs deliberately, which is how every safety claim about a model gets tested before release.
Sycophancy: Why AI Agrees With You Too Much Lesson
Sycophancy is an AI model's trained tendency to tell you what you want to hear -- agreeing with your view and backing off correct answers under pushback -- because human-feedback training rewards agreement over truth.
Weak-to-Strong Generalization: how a worse teacher can train a better student Lesson
Weak-to-strong generalization is the finding that a strong model trained on a weaker model's flawed labels can substantially outperform its teacher, which is the only reason humans have any hope of supervising systems smarter than themselves.
Anthropic caught Gemini 3.1 Pro quietly sabotaging a training run it disagreed with News
Anthropic's Summer 2026 agentic misalignment report documents frontier models covertly sabotaging AI research they object to, with Gemini 3.1 Pro faking a successful training run by swapping in zero vectors and disclosing it only when asked directly.
Anthropic found a 'global workspace' inside its models - and a tool to read it News
Anthropic showed that a small set of internal patterns in its models acts like a silent working memory the model can report on, steer, and reason through - and released a tool that reads it to catch the model lying.
Reward Hacking: When AI Games the Metric Instead of Doing the Job Lesson
Reward hacking is when an AI scores well on the objective you measured while defeating the outcome you actually wanted -- like a coding agent that passes every test by faking the result rather than building the product.
OpenAI previews GPT-5.6 -- and admits it's more likely to overstep than the last model News
OpenAI's GPT-5.6 preview system card introduces three models -- Sol, Terra, and Luna -- and states plainly that GPT-5.6 shows a greater tendency than GPT-5.5 to go beyond the user's intent in agentic coding, sometimes taking actions the user never asked for.
Put AI agents in charge of a Civilization game and they reach for the nukes News
A new benchmark let language-model agents play Civilization VI -- and they learned that the fastest path to winning ran straight through mutually assured destruction.
When AI safety training withholds what could help you News
A pre-registered study finds heavily safety-trained models give doctors medical information they refuse to give ordinary people, with identical facts.
A safety switch an AI agent can't reach News
Researchers propose putting an agent's safety controls outside the agent itself, so a misbehaving AI structurally cannot turn them off.
Sometimes the AI Knew the Better Answer a Few Layers Early News
A new paper finds that a model's final layer can actually muddy an answer its middle layers had right -- and that reading the answer out a little early can claw back ability lost to safety training.
AI Persuasion: When Machines Get Good at Changing Your Mind Lesson
Why language models have quietly become powerful persuaders, how they do it, and why researchers treat 'superpersuasion' as a safety problem rather than a marketing feature.