computer-use
GPT-6 Astra improves computer use sharply, but OpenAI reports a monitoring trade-off News
OpenAI's GPT-6 Astra posts its clearest gains in computer use and coding-agent tasks while costing 2.5 times GPT-5.6 Sol per token, and its system card says chain-of-thought-only monitoring is weaker even as prompt-injection robustness improves.
The AI judges grading computer-use agents are too easy on them News
A new benchmark finds that vision-language models used to grade whether a computer-use agent finished its task systematically accept failed runs as successes, and that judgment quality varies more across operating systems than across judges.
An agent's memory records what you said; this compiler records what you did News
A single-author paper argues computer-use agents waste frontier inference re-deriving routines their user already performed, and presents a model-free compiler that turns raw screen capture into a context block 86 times smaller that an agent reads with 98.4 percent accuracy.
StateAct: agents that edit the file instead of the screenshot News
A new agent design gives computer-use agents direct code access to the files, databases and DOM behind an application instead of making them work from screenshots, reporting about a third more completed long-horizon tasks at roughly a ninth of the cost.
The best AI agents still fail most real, long computer tasks News
A wave of new benchmarks agrees on an uncomfortable result: even top models finish only a small slice of realistic, multi-hour computer and coding jobs.
Google's fast model can now use a computer by itself News
Gemini 3.5 Flash gained built-in 'computer use,' letting one model click, type, and act across browsers, phones, and desktops.
OS-Shepherd-9B Tool
A 9B reward model trained specifically to judge whether a computer-use agent actually finished its task, built to cut the false-success verdicts that general-purpose vision-language judges produce. A 35B sibling and the OSReward benchmark ship alongside it.
Gemini 3.5 Flash computer use Tool
Google's fast model can now operate a browser, phone, or desktop directly as a built-in tool, with optional confirm-before-acting and auto-stop-on-attack safeguards for building automation agents.
Fara 1.5-27B Tool
Microsoft's MIT-licensed 27B multimodal agent that operates web browsers from screenshots alone, emitting clicks, typing, scrolling, and navigation, and trained to pause on ambiguity or unauthorized irreversible actions.
Claude computer use tool Tool
Anthropic's desktop-control toolset reached general availability, giving a model screenshot capture plus mouse and keyboard control for driving real applications. A separate browser-use toolset acts on page structure rather than pixels, which is usually the better choice for web work.