Ground Truth.
AI, checked against the source.

← All topics

computer-use

Everything on Ground Truth tagged “computer-use” — 18 items.

Vercel Labs’ Agent Desktop reaches 1.0 with structured desktop control News

Vercel Labs released Agent Desktop 1.0, a Rust command-line tool and C library that let agents inspect accessibility trees and operate desktop controls.

WildAWM trains computer agents inside replayable synthetic workplaces News

WildAWM reports transfer from 341 verified synthetic computer tasks to eight external benchmarks, with no clear gain on the hardest task quartile.

Work2Skill turns desktop demonstrations into reusable agent procedures News

Work2Skill converted 350 curated desktop demonstrations into textual procedures and reported better agent scores when those procedures were reused on related tasks.

SoftwareGym trains a desktop agent on generated applications and reports transfer to real-app tests News

SoftwareGym’s researchers generated 182 desktop applications and reported improved performance on an existing-app benchmark after training an agent on those synthetic environments.

OpenAI’s Ironclad research improves workflow scores, without announcing a customer agent News

OpenAI reports GPT-6 Astra met 55% of criteria across 11 Ironclad research tasks, up from 41.6% for GPT-5.6 Sol.

GPT-6 Astra improves computer use sharply, but OpenAI reports a monitoring trade-off News

OpenAI's GPT-6 Astra posts its clearest gains in computer use and coding-agent tasks while costing 2.5 times GPT-5.6 Sol per token, and its system card says chain-of-thought-only monitoring is weaker even as prompt-injection robustness improves.

The AI judges grading computer-use agents are too easy on them News

A new benchmark finds that vision-language models used to grade whether a computer-use agent finished its task systematically accept failed runs as successes, and that judgment quality varies more across operating systems than across judges.

An agent's memory records what you said; this compiler records what you did News

A single-author paper argues computer-use agents waste frontier inference re-deriving routines their user already performed, and presents a model-free compiler that turns raw screen capture into a context block 86 times smaller that an agent reads with 98.4 percent accuracy.

StateAct: agents that edit the file instead of the screenshot News

A new agent design gives computer-use agents direct code access to the files, databases and DOM behind an application instead of making them work from screenshots, reporting about a third more completed long-horizon tasks at roughly a ninth of the cost.

The best AI agents still fail most real, long computer tasks News

A wave of new benchmarks agrees on an uncomfortable result: even top models finish only a small slice of realistic, multi-hour computer and coding jobs.

Google's fast model can now use a computer by itself News

Gemini 3.5 Flash gained built-in 'computer use,' letting one model click, type, and act across browsers, phones, and desktops.

OS-Shepherd-9B Tool

A 9B reward model trained specifically to judge whether a computer-use agent actually finished its task, built to cut the false-success verdicts that general-purpose vision-language judges produce. A 35B sibling and the OSReward benchmark ship alongside it.

Nex-N2.5-Pro Tool

Released 8 September under Apache 2.0: a 397-billion-parameter model from Nex AGI aimed at agentic work such as computer use and browsing. The repository's files total 407 GB.

Gemini 3.5 Flash computer use Tool

Google's fast model can now operate a browser, phone, or desktop directly as a built-in tool, with optional confirm-before-acting and auto-stop-on-attack safeguards for building automation agents.

Fara 1.5-27B Tool

Microsoft's MIT-licensed 27B multimodal agent that operates web browsers from screenshots alone, emitting clicks, typing, scrolling, and navigation, and trained to pause on ambiguity or unauthorized irreversible actions.

Claude computer use tool Tool

Anthropic's desktop-control toolset reached general availability, giving a model screenshot capture plus mouse and keyboard control for driving real applications. A separate browser-use toolset acts on page structure rather than pixels, which is usually the better choice for web work.

CUA-S1-FORMS Tool

An MIT-licensed specialist that selects candidate document values and fixed actions for structured form interactions.

Agent Desktop Tool

Vercel Labs’ shipping Rust command-line tool and C library expose desktop accessibility structure and control operations to agents; version 1.0.0 was released October 28.