# Desktop control tool for AI agents

Developed by Vercel Labs, agent-desktop is a command-line interface (CLI) that enables AI agents to read and manage desktop applications via the operating system's accessibility tree. Written in Rust, this tool aims to enhance the computer use capabilities of agents.

- ★ 18,250
- Rust
- GitHub Trending · 2026-11-03

## Updates

- **November 7, 2026:** Stars 17,192 → 18,250, latest release v1.2.0 (November 5, 2026).
- **November 6, 2026:** Stars 15,577 → 17,192, latest release v1.2.0 (November 5, 2026).
- **November 5, 2026:** Stars 13,264 → 15,577, latest release v1.2.0 (November 5, 2026).
- **November 4, 2026:** Stars 10,531 → 13,264, latest release v1.1.0 (November 3, 2026).

## What you get

- Reads desktop applications via the operating system accessibility tree
- Interacts with elements without requiring pixel matching
- Generates fast and structured responses in JSON format

## Installation

**Install with package manager**

```
npm install -g agent-desktop
agent-desktop version
```

**Add skill**

```
npx skills add https://github.com/vercel-labs/agent-desktop --skill agent-desktop
```

## If you don't write code

Paste this into your AI agent (Claude Code · Codex · Antigravity)

I want to manage desktop applications using the Agent Desktop tool. To complete the installation, run npm install -g agent-desktop, run the agent-desktop version command, and use the npx skills add https://github.com/vercel-labs/agent-desktop --skill agent-desktop command to add agent capabilities.

Repository: https://github.com/vercel-labs/agent-desktop. Follow the official instructions in the README of this repository for setup and execution.

Before starting, check which OS we are on and if the necessary tools (e.g., Python, Node.js, Git, Docker) are installed. Install any missing ones step-by-step according to this system.

Create a new, empty folder to work in. Do not touch any files outside this folder and do not delete anything. Tell me what you are going to do in one sentence before running each command.

Tell me what I should see on the screen at the end of each step. If an error occurs, I will paste the error message to you exactly as it is, and we will fix it together.

## Related dictionary terms

- [Computer Use](https://trescout.com/en/dictionary/computer-use/)
- [AI Skills](https://trescout.com/en/dictionary/ai-skills/)
- [Agent](https://trescout.com/en/dictionary/agent/)
- [CLI](https://trescout.com/en/dictionary/cli/)
- [Rust](https://trescout.com/en/dictionary/rust/)
- [Artificial Intelligence](https://trescout.com/en/dictionary/artificial-intelligence/)

- **Who it is for:** Suitable for AI developers who want to automatically manage and test desktop applications.
- **License:** Apache-2.0

## Links

- [GitHub repository →](https://github.com/vercel-labs/agent-desktop)
- [Read in Turkish →](https://trescout.com/discover/agent-desktop/)

TreScout did not build this tool · we found it in GitHub trends and wrote it up. This page describes the repository as of 2026-11-03: The star count and our text belong to that day, the repository may have changed since. Check the repository link for the current state. The introductory text was prepared with AI from the repository's own documentation, and this page was **machine-translated** from the Turkish original · the Turkish version prevails.

---
Source: TreScout Discover · https://trescout.com/en/discover/agent-desktop/