Vercel Labs releases agent-desktop for AI agents to use computers

Vercel Labs released agent-desktop, an open source tool for AI agents. It gives each agent computer use on macOS, Windows and Linux. Computer use is when the agent operates the software on a computer. The tool is a command-line tool in the Rust language, with the Apache-2.0 licence. The release has no test results.

How it works

The tool reads the accessibility trees of the operating system. An accessibility tree is a record of the items on the screen, such as buttons and fields.

The agent then uses stable refs. A ref is a permanent name for one item. Other methods look at pixels, the small points of a screen image.

The numbers

The release has no numbers, no test results and no speed data. Vercel Labs states that the tool works with each agent.

What is not known

• How correctly the tool works on tasks of a user.
• How safe it is when an agent controls a full computer.
• Which agents and which versions of the operating systems the company used in tests.

Insight: Vercel Labs builds the parts around the agent

In August 2026, Vercel Labs released fx, an experimental coding agent that a script can start from the command line. At this time, agent-desktop gives agents control of a desktop, also from the command line. This reads as a plan to supply open parts for agents. Maybe more tools then follow the style of Vercel Labs. Look for other agent makers that use agent-desktop.