Vercel Labs Open Sources Agent‑Desktop: Token‑Efficient OS AI Agent

Vercel Labs releases the source code of agent‑desktop, an OS‑level AI agent that reads the accessibility tree, uses few tokens, runs in background, and supports multiple cursors.

cpaua1 min2

Vercel Labs has opened the source code of agent-desktop.

The tool brings the Computer Use approach, familiar from agent-browser, to the entire operating system, and is characterized by economical token usage.

The main feature of the tool is that it does not require screenshots. Instead of analyzing images, the agent directly reads the system's accessibility tree, obtaining information about buttons, input fields, and other interface elements.

At the same time, agent-desktop runs in the background and does not intercept mouse control, so the user can continue working on the computer. Simultaneous operation of multiple agents is also supported, each receiving its own cursor.

Grok Bot is happy.

Share

Author

cpaua

VibeCode blog admin. Writing about vibe coding, AI and open source.

Comments

To leave a comment, log in or sign up
Loading...

Weekly digest

The best of vibe coding, AI agents and open source — once a week, no spam.