
Computer Use MCP
- 345 repo stars
- Updated August 5, 2026
- domdomegg/computer-use-mcp
Computer Use MCP is domdomegg's MCP server that hands a coding agent the desktop. It takes screenshots, moves and clicks the mouse, and types, so an agent can operate applications that expose no API. Install it over npx for stdio clients, or download the mcpb bundle and open it with Claude Desktop.
About
Computer Use MCP turns a coding agent into a cautious desktop operator: it can grab screenshots, move the pointer, click, and type so developers can script one-off migrations, reproduce bugs in thick-client apps, or demo flows where no stable API exists. That power fits the agent-tooling slice of Build, but it demands discipline—run only on machines you control, expect elevated risk compared to read-only MCP servers, and keep humans in the loop for auth and destructive steps. Distribution matches other domdomegg servers: npx for stdio agents and an mcpb release artifact for clients that prefer bundled MCP binaries. It complements browser MCPs when the target is native OS UI rather than a tab. Treat it as advanced automation glue, not a replacement for proper integration design when a vendor offers a documented API.
- Capture screenshots for visual grounding before actions
- Drive mouse movement and clicks through MCP tools
- Send keyboard input for form fill and shortcut workflows
- Install via npx stdio or published mcpb bundle for supported clients
- Published server version 1.8.0 as computer-use-mcp
Computer Use MCP by the numbers
- Data as of Aug 10, 2026 (Skillselion catalog sync)
claude mcp add computer-use-mcp -- npx -y computer-use-mcpAdd your badge
Show developers this MCP server is listed on Skillselion. Paste this into your README.
| repo stars | ★ 345 |
|---|---|
| Package | computer-use-mcp |
| Transport | STDIO |
| Auth | None |
| Last updated | August 5, 2026 |
| Repository | domdomegg/computer-use-mcp ↗ |
What it does
Give your agent controlled desktop automation—screenshots plus mouse and keyboard actions—when GUI-only tools have no API.
Who is it for?
Advanced developers automating legacy desktop tools, reproducing visual bugs, or scripting personal workflows on a trusted local machine.
Skip if: Shared servers, unattended production bots, or anyone who needs least-privilege automation without full desktop control risk.
What you get
After registration, the agent can observe the screen and perform bounded mouse and keyboard actions to complete tasks that lack APIs.
- Screenshot-backed context for agent reasoning about on-screen UI
- Executed click and type sequences driven through MCP
- Repeatable stdio or mcpb MCP registration for trusted dev hosts
By the numbers
- Server version 1.8.0
- npm identifier computer-use-mcp
- Published mcpb release for v1.8.0
README.md
computer-use-mcp
💻 A Model Context Protocol server for Claude to control your computer. This is very similar to computer use, but easy to set up and use locally.
Here's Claude Haiku 4.5 changing my desktop background (4x speed):
https://github.com/user-attachments/assets/cd0bc190-52c4-49db-b3bc-4b8a74544789
[!WARNING] At time of writing, models make frequent mistakes and are vulnerable to prompt injections. As this MCP server gives the model complete control of your computer, this could do a lot of damage. You should therefore treat this like giving a hyperactive toddler access to your computer - you probably want to supervise it closely, and consider only doing this in a sandboxed user account.
Installation
Claude Code
Run:
claude mcp add --scope user --transport stdio computer-use -- npx -y computer-use-mcp
This installs the server at user scope (available in all projects). To install locally (current directory only), omit --scope user.
Claude Desktop
(Recommended) Via manual .mcpb installation
- Find the latest mcpb build in the GitHub Actions history (the top one)
- In the 'Artifacts' section, download the
computer-use-mcp-mcpbfile - Rename the
.zipfile to.mcpb - Double-click the
.mcpbfile to open with Claude Desktop - Click "Install"
(Advanced) Alternative: Via JSON configuration
- Install Node.js
- Open Claude Desktop and go to Settings → Developer
- Click "Edit Config" to open your
claude_desktop_config.jsonfile - Add the following configuration to the "mcpServers" section:
{
"mcpServers": {
"computer-use": {
"command": "npx",
"args": [
"-y",
"computer-use-mcp"
]
}
}
}
- Save the file and restart Claude Desktop
Cursor
(Recommended) Via one-click install
(Advanced) Alternative: Via JSON configuration
Create either a global (~/.cursor/mcp.json) or project-specific (.cursor/mcp.json) configuration file:
{
"mcpServers": {
"computer-use": {
"command": "npx",
"args": ["-y", "computer-use-mcp"]
}
}
}
Cline
(Recommended) Via marketplace
- Click the "MCP Servers" icon in the Cline extension
- Search for "Computer Use" and click "Install"
- Follow the prompts to install the server
(Advanced) Alternative: Via JSON configuration
- Click the "MCP Servers" icon in the Cline extension
- Click on the "Installed" tab, then the "Configure MCP Servers" button at the bottom
- Add the following configuration to the "mcpServers" section:
{
"mcpServers": {
"computer-use": {
"type": "stdio",
"command": "npx",
"args": ["-y", "computer-use-mcp"]
}
}
}
Tips
This should just work out of the box.
However, to get best results:
- Use a model good at computer use - I recommend the latest Claude models.
- Use a small, common resolution - 720p works particularly well. On macOS, you can use displayoverride-mac to do this. If you can't use a different resolution, try zooming in to active windows.
- Install and enable the Rango browser extension. This enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can bump up the font size setting in Rango to make the hints more visible.
How it works
We implement a near identical computer use tool to Anthropic's official computer use guide, with some more nudging to prefer keyboard shortcuts.
This talks to your computer using nut.js
Contributing
Pull requests are welcomed on GitHub! To get started:
- Install Git and Node.js
- Clone the repository
- Install dependencies with
npm install - Run
npm run testto run tests - Build with
npm run build
Releases
Versions follow the semantic versioning spec.
To release:
- Use
npm version <major | minor | patch>to bump the version - Run
git push --follow-tagsto push with tags - Wait for GitHub Actions to publish to the NPM registry.
Recommended MCP Servers
How it compares
OS-level computer-use MCP, not a read-only fetch tool or a single-site browser skill.
FAQ
How do I set up Claude computer use on my own machine?
Add the server with the claude mcp add command shown above, at user scope for every project or without the scope flag for the current directory. Claude can then screenshot the display and act on it with the mouse and keyboard.
Is it safe to run a computer use agent on my main machine?
The README says to treat it like giving a hyperactive toddler access to your computer: models make frequent mistakes, they are vulnerable to prompt injection, and this server gives the model complete control. The project recommends close supervision and a sandboxed user account.
Who is Computer Use MCP MCP for?
Experienced developers and agent users who need GUI automation on their own machine when APIs are missing and they accept desktop control risks.
When should I use Computer Use MCP MCP?
Use it during Build for agent-tooling experiments, legacy app workflows, or visual verification—not as a default for every coding task.
How do I add Computer Use MCP MCP to my agent?
Add computer-use-mcp via npx stdio or install the published v1.8.0 mcpb bundle per your client’s MCP instructions, on a host where screen and input access is intentional.