computer-use
The AI judges grading computer-use agents are too easy on them News
A new benchmark finds that vision-language models used to grade whether a computer-use agent finished its task systematically accept failed runs as successes, and that judgment quality varies more across operating systems than across judges.
An agent's memory records what you said; this compiler records what you did News
A single-author paper argues computer-use agents waste frontier inference re-deriving routines their user already performed, and presents a model-free compiler that turns raw screen capture into a context block 86 times smaller that an agent reads with 98.4 percent accuracy.
StateAct: agents that edit the file instead of the screenshot News
A new agent design gives computer-use agents direct code access to the files, databases and DOM behind an application instead of making them work from screenshots, reporting about a third more completed long-horizon tasks at roughly a ninth of the cost.
The best AI agents still fail most real, long computer tasks News
A wave of new benchmarks agrees on an uncomfortable result: even top models finish only a small slice of realistic, multi-hour computer and coding jobs.
Google's fast model can now use a computer by itself News
Gemini 3.5 Flash gained built-in 'computer use,' letting one model click, type, and act across browsers, phones, and desktops.
OS-Shepherd-9B Tool
A 9B reward model trained specifically to judge whether a computer-use agent actually finished its task, built to cut the false-success verdicts that general-purpose vision-language judges produce. A 35B sibling and the OSReward benchmark ship alongside it.
Gemini 3.5 Flash computer use Tool
Google's fast model can now operate a browser, phone, or desktop directly as a built-in tool, with optional confirm-before-acting and auto-stop-on-attack safeguards for building automation agents.
Fara 1.5-27B Tool
Microsoft's MIT-licensed 27B multimodal agent that operates web browsers from screenshots alone, emitting clicks, typing, scrolling, and navigation, and trained to pause on ambiguity or unauthorized irreversible actions.