drio
Open app

Apache Beam MCP Server

Source

MCP server to manage apache beam workflows with different runners

Catalog onlyCatalog onlySTDIO

Overview

The Apache Beam MCP Server is a Model Context Protocol (MCP) server designed to manage Apache Beam workflows across various runners such as Flink, Spark, Dataflow, and Direct.

To use the server, clone the repository, set up a virtual environment, install dependencies, and start the server with the desired runner. You can then submit jobs using the provided API endpoints.

  • Multi-runner support for Flink, Spark, Dataflow, and Direct. - MCP compliant for AI integration. - Pipeline management capabilities including creation, monitoring, and control. - Easy extensibility for adding new runners or features. - Production-ready with Docker and Kubernetes support.
  1. Managing data pipelines for ETL processes.
  2. Enabling AI-driven data processing workflows.
  3. Simplifying DevOps tasks related to data pipeline operations.

Add to your AI client

Use these steps to connect Apache Beam MCP Server in Cursor, Claude, VS Code, and other MCP-compatible apps. The same JSON appears in the Use with menu above for one-click copy.

Cursor

Add this to your .cursor/mcp.json file in your project root, then restart Cursor.

.cursor/mcp.json

{
  "mcpServers": {
    "beam-mcp-server-souravch": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-beam-mcp-server-souravch"
      ]
    }
  }
}

Claude Desktop

Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.

~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)

{
  "mcpServers": {
    "beam-mcp-server-souravch": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-beam-mcp-server-souravch"
      ]
    }
  }
}

Claude Code

Add this to your project's .mcp.json file. Claude Code will detect it automatically.

.mcp.json (project root)

{
  "mcpServers": {
    "beam-mcp-server-souravch": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-beam-mcp-server-souravch"
      ]
    }
  }
}

VS Code (Copilot)

Add this to your .vscode/mcp.json file. Requires the GitHub Copilot extension with MCP support enabled.

.vscode/mcp.json

{
  "servers": {
    "beam-mcp-server-souravch": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-beam-mcp-server-souravch"
      ]
    }
  }
}

Windsurf

Add this to your Windsurf MCP config file, then restart Windsurf.

~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "beam-mcp-server-souravch": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-beam-mcp-server-souravch"
      ]
    }
  }
}

Cline

Open Cline settings, navigate to MCP Servers, and add this server configuration.

Cline MCP Settings (via UI)

{
  "mcpServers": {
    "beam-mcp-server-souravch": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-beam-mcp-server-souravch"
      ]
    }
  }
}

FAQ

**What is the purpose of the MCP Server?**

It standardizes the management of data pipelines across different execution environments.

**Is it easy to deploy?**

Yes, it supports Docker and Kubernetes for easy deployment.

**Can it handle large-scale data processing?**

Yes, it is designed for production use and can scale with your data processing needs.

Developer tools