Now liveThe Skillselion MCP - thousands of ranked skills, loaded into your agent mid-task. No install.Get it →
domdomegg avatar

Computer Use MCP

  • 345 repo stars
  • Updated August 5, 2026
  • domdomegg/computer-use-mcp

Computer Use MCP is domdomegg's MCP server that hands a coding agent the desktop. It takes screenshots, moves and clicks the mouse, and types, so an agent can operate applications that expose no API. Install it over npx for stdio clients, or download the mcpb bundle and open it with Claude Desktop.

About

Computer Use MCP turns a coding agent into a cautious desktop operator: it can grab screenshots, move the pointer, click, and type so developers can script one-off migrations, reproduce bugs in thick-client apps, or demo flows where no stable API exists. That power fits the agent-tooling slice of Build, but it demands discipline—run only on machines you control, expect elevated risk compared to read-only MCP servers, and keep humans in the loop for auth and destructive steps. Distribution matches other domdomegg servers: npx for stdio agents and an mcpb release artifact for clients that prefer bundled MCP binaries. It complements browser MCPs when the target is native OS UI rather than a tab. Treat it as advanced automation glue, not a replacement for proper integration design when a vendor offers a documented API.

  • Capture screenshots for visual grounding before actions
  • Drive mouse movement and clicks through MCP tools
  • Send keyboard input for form fill and shortcut workflows
  • Install via npx stdio or published mcpb bundle for supported clients
  • Published server version 1.8.0 as computer-use-mcp

Computer Use MCP by the numbers

  • Data as of Aug 10, 2026 (Skillselion catalog sync)
terminal
claude mcp add computer-use-mcp -- npx -y computer-use-mcp

Add your badge

Show developers this MCP server is listed on Skillselion. Paste this into your README.

Listed on Skillselion
repo stars345
Packagecomputer-use-mcp
TransportSTDIO
AuthNone
Last updatedAugust 5, 2026
Repositorydomdomegg/computer-use-mcp

What it does

Give your agent controlled desktop automation—screenshots plus mouse and keyboard actions—when GUI-only tools have no API.

Who is it for?

Advanced developers automating legacy desktop tools, reproducing visual bugs, or scripting personal workflows on a trusted local machine.

Skip if: Shared servers, unattended production bots, or anyone who needs least-privilege automation without full desktop control risk.

What you get

After registration, the agent can observe the screen and perform bounded mouse and keyboard actions to complete tasks that lack APIs.

  • Screenshot-backed context for agent reasoning about on-screen UI
  • Executed click and type sequences driven through MCP
  • Repeatable stdio or mcpb MCP registration for trusted dev hosts

By the numbers

  • Server version 1.8.0
  • npm identifier computer-use-mcp
  • Published mcpb release for v1.8.0
README.md

computer-use-mcp

💻 A Model Context Protocol server for Claude to control your computer. This is very similar to computer use, but easy to set up and use locally.

Here's Claude Haiku 4.5 changing my desktop background (4x speed):

https://github.com/user-attachments/assets/cd0bc190-52c4-49db-b3bc-4b8a74544789

[!WARNING] At time of writing, models make frequent mistakes and are vulnerable to prompt injections. As this MCP server gives the model complete control of your computer, this could do a lot of damage. You should therefore treat this like giving a hyperactive toddler access to your computer - you probably want to supervise it closely, and consider only doing this in a sandboxed user account.

Installation

Claude Code

Run:

claude mcp add --scope user --transport stdio computer-use -- npx -y computer-use-mcp

This installs the server at user scope (available in all projects). To install locally (current directory only), omit --scope user.

Claude Desktop
(Recommended) Via manual .mcpb installation
  1. Find the latest mcpb build in the GitHub Actions history (the top one)
  2. In the 'Artifacts' section, download the computer-use-mcp-mcpb file
  3. Rename the .zip file to .mcpb
  4. Double-click the .mcpb file to open with Claude Desktop
  5. Click "Install"
(Advanced) Alternative: Via JSON configuration
  1. Install Node.js
  2. Open Claude Desktop and go to Settings → Developer
  3. Click "Edit Config" to open your claude_desktop_config.json file
  4. Add the following configuration to the "mcpServers" section:
{
  "mcpServers": {
    "computer-use": {
      "command": "npx",
      "args": [
        "-y",
        "computer-use-mcp"
      ]
    }
  }
}
  1. Save the file and restart Claude Desktop
Cursor
(Recommended) Via one-click install
  1. Click Install MCP Server
(Advanced) Alternative: Via JSON configuration

Create either a global (~/.cursor/mcp.json) or project-specific (.cursor/mcp.json) configuration file:

{
  "mcpServers": {
    "computer-use": {
      "command": "npx",
      "args": ["-y", "computer-use-mcp"]
    }
  }
}
Cline
(Recommended) Via marketplace
  1. Click the "MCP Servers" icon in the Cline extension
  2. Search for "Computer Use" and click "Install"
  3. Follow the prompts to install the server
(Advanced) Alternative: Via JSON configuration
  1. Click the "MCP Servers" icon in the Cline extension
  2. Click on the "Installed" tab, then the "Configure MCP Servers" button at the bottom
  3. Add the following configuration to the "mcpServers" section:
{
  "mcpServers": {
    "computer-use": {
      "type": "stdio",
      "command": "npx",
      "args": ["-y", "computer-use-mcp"]
    }
  }
}

Tips

This should just work out of the box.

However, to get best results:

  • Use a model good at computer use - I recommend the latest Claude models.
  • Use a small, common resolution - 720p works particularly well. On macOS, you can use displayoverride-mac to do this. If you can't use a different resolution, try zooming in to active windows.
  • Install and enable the Rango browser extension. This enables keyboard navigation for websites, which is far more reliable than Claude trying to click coordinates. You can bump up the font size setting in Rango to make the hints more visible.

How it works

We implement a near identical computer use tool to Anthropic's official computer use guide, with some more nudging to prefer keyboard shortcuts.

This talks to your computer using nut.js

Contributing

Pull requests are welcomed on GitHub! To get started:

  1. Install Git and Node.js
  2. Clone the repository
  3. Install dependencies with npm install
  4. Run npm run test to run tests
  5. Build with npm run build

Releases

Versions follow the semantic versioning spec.

To release:

  1. Use npm version <major | minor | patch> to bump the version
  2. Run git push --follow-tags to push with tags
  3. Wait for GitHub Actions to publish to the NPM registry.

Recommended MCP Servers

How it compares

OS-level computer-use MCP, not a read-only fetch tool or a single-site browser skill.

FAQ

How do I set up Claude computer use on my own machine?

Add the server with the claude mcp add command shown above, at user scope for every project or without the scope flag for the current directory. Claude can then screenshot the display and act on it with the mouse and keyboard.

Is it safe to run a computer use agent on my main machine?

The README says to treat it like giving a hyperactive toddler access to your computer: models make frequent mistakes, they are vulnerable to prompt injection, and this server gives the model complete control. The project recommends close supervision and a sandboxed user account.

Who is Computer Use MCP MCP for?

Experienced developers and agent users who need GUI automation on their own machine when APIs are missing and they accept desktop control risks.

When should I use Computer Use MCP MCP?

Use it during Build for agent-tooling experiments, legacy app workflows, or visual verification—not as a default for every coding task.

How do I add Computer Use MCP MCP to my agent?

Add computer-use-mcp via npx stdio or install the published v1.8.0 mcpb bundle per your client’s MCP instructions, on a host where screen and input access is intentional.

Web & Browser Automationautomationagents

This week in AI coding

Five minutes, every Monday - the tools, releases and tactics for developers.

unsubscribe anytime.