drio
Open app

omniparser-autogui-mcp

Source

Automatic operation of on-screen GUI.

Catalog onlyCatalog onlySTDIO

Overview

Omniparser-autogui-mcp is a tool that automates the operation of on-screen graphical user interfaces (GUIs) by analyzing the screen using the OmniParser framework.

To use omniparser-autogui-mcp, clone the repository, install the necessary models, and configure the settings in the 'claude_desktop_config.json' file to specify the command and environment variables.

  • Automatic GUI operation based on screen analysis. - Compatibility with Windows. - Customizable settings for different environments and use cases.
  1. Automating repetitive tasks in software applications.
  2. Enhancing accessibility for users with disabilities.
  3. Streamlining workflows by automating GUI interactions.

Add to your AI client

Use these steps to connect omniparser-autogui-mcp in Cursor, Claude, VS Code, and other MCP-compatible apps. The same JSON appears in the Use with menu above for one-click copy.

Cursor

Add this to your .cursor/mcp.json file in your project root, then restart Cursor.

.cursor/mcp.json

{
  "mcpServers": {
    "omniparser-autogui-mcp-non906": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-omniparser-autogui-mcp-non906"
      ]
    }
  }
}

Claude Desktop

Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.

~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)

{
  "mcpServers": {
    "omniparser-autogui-mcp-non906": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-omniparser-autogui-mcp-non906"
      ]
    }
  }
}

Claude Code

Add this to your project's .mcp.json file. Claude Code will detect it automatically.

.mcp.json (project root)

{
  "mcpServers": {
    "omniparser-autogui-mcp-non906": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-omniparser-autogui-mcp-non906"
      ]
    }
  }
}

VS Code (Copilot)

Add this to your .vscode/mcp.json file. Requires the GitHub Copilot extension with MCP support enabled.

.vscode/mcp.json

{
  "servers": {
    "omniparser-autogui-mcp-non906": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-omniparser-autogui-mcp-non906"
      ]
    }
  }
}

Windsurf

Add this to your Windsurf MCP config file, then restart Windsurf.

~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "omniparser-autogui-mcp-non906": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-omniparser-autogui-mcp-non906"
      ]
    }
  }
}

Cline

Open Cline settings, navigate to MCP Servers, and add this server configuration.

Cline MCP Settings (via UI)

{
  "mcpServers": {
    "omniparser-autogui-mcp-non906": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-omniparser-autogui-mcp-non906"
      ]
    }
  }
}

FAQ

Is omniparser-autogui-mcp compatible with other operating systems?

Currently, it is confirmed to work on Windows, but other systems may require additional configurations.

What is the license for omniparser-autogui-mcp?

It is under the MIT license, excluding submodules and packages which may have different licenses.

Os automation