computer-use
Vercel Labs’ Agent Desktop reaches 1.0 with structured desktop control News
Vercel Labs released Agent Desktop 1.0, a Rust command-line tool and C library that let agents inspect accessibility trees and operate desktop controls.
WildAWM trains computer agents inside replayable synthetic workplaces News
WildAWM reports transfer from 341 verified synthetic computer tasks to eight external benchmarks, with no clear gain on the hardest task quartile.
Work2Skill turns desktop demonstrations into reusable agent procedures News
Work2Skill converted 350 curated desktop demonstrations into textual procedures and reported better agent scores when those procedures were reused on related tasks.
SoftwareGym trains a desktop agent on generated applications and reports transfer to real-app tests News
SoftwareGym’s researchers generated 182 desktop applications and reported improved performance on an existing-app benchmark after training an agent on those synthetic environments.
OpenAI’s Ironclad research improves workflow scores, without announcing a customer agent News
OpenAI reports GPT-6 Astra met 55% of criteria across 11 Ironclad research tasks, up from 41.6% for GPT-5.6 Sol.
GPT-6 Astra improves computer use sharply, but OpenAI reports a monitoring trade-off News
OpenAI's GPT-6 Astra posts its clearest gains in computer use and coding-agent tasks while costing 2.5 times GPT-5.6 Sol per token, and its system card says chain-of-thought-only monitoring is weaker even as prompt-injection robustness improves.
The AI judges grading computer-use agents are too easy on them News
A new benchmark finds that vision-language models used to grade whether a computer-use agent finished its task systematically accept failed runs as successes, and that judgment quality varies more across operating systems than across judges.
An agent's memory records what you said; this compiler records what you did News
A single-author paper argues computer-use agents waste frontier inference re-deriving routines their user already performed, and presents a model-free compiler that turns raw screen capture into a context block 86 times smaller that an agent reads with 98.4 percent accuracy.
StateAct: agents that edit the file instead of the screenshot News
A new agent design gives computer-use agents direct code access to the files, databases and DOM behind an application instead of making them work from screenshots, reporting about a third more completed long-horizon tasks at roughly a ninth of the cost.
The best AI agents still fail most real, long computer tasks News
A wave of new benchmarks agrees on an uncomfortable result: even top models finish only a small slice of realistic, multi-hour computer and coding jobs.
Google's fast model can now use a computer by itself News
Gemini 3.5 Flash gained built-in 'computer use,' letting one model click, type, and act across browsers, phones, and desktops.
OS-Shepherd-9B Tool
A 9B reward model trained specifically to judge whether a computer-use agent actually finished its task, built to cut the false-success verdicts that general-purpose vision-language judges produce. A 35B sibling and the OSReward benchmark ship alongside it.
Nex-N2.5-Pro Tool
Released 8 September under Apache 2.0: a 397-billion-parameter model from Nex AGI aimed at agentic work such as computer use and browsing. The repository's files total 407 GB.
Gemini 3.5 Flash computer use Tool
Google's fast model can now operate a browser, phone, or desktop directly as a built-in tool, with optional confirm-before-acting and auto-stop-on-attack safeguards for building automation agents.
Fara 1.5-27B Tool
Microsoft's MIT-licensed 27B multimodal agent that operates web browsers from screenshots alone, emitting clicks, typing, scrolling, and navigation, and trained to pause on ambiguity or unauthorized irreversible actions.
Claude computer use tool Tool
Anthropic's desktop-control toolset reached general availability, giving a model screenshot capture plus mouse and keyboard control for driving real applications. A separate browser-use toolset acts on page structure rather than pixels, which is usually the better choice for web work.
CUA-S1-FORMS Tool
An MIT-licensed specialist that selects candidate document values and fixed actions for structured form interactions.
Agent Desktop Tool
Vercel Labs’ shipping Rust command-line tool and C library expose desktop accessibility structure and control operations to agents; version 1.0.0 was released October 28.