Multimodal Model Context Protocol Server

A multimodal mcp server

Catalog onlyCatalog onlySTDIO

Overview

Pixeltable MCP Server is a multimodal model context protocol server designed to handle indexing and querying of various data types including audio, video, images, and documents.

To use the Pixeltable MCP Server, clone the repository, install the necessary dependencies, and run the services using Docker. Each service can be accessed through designated endpoints for audio, video, images, and documents.

Audio file indexing with transcription capabilities - Video file indexing with frame extraction - Image indexing with object detection - Document indexing with text extraction and RAG support - Multi-index support for various data types

Indexing and searching audio files for content.
Extracting frames from videos for analysis.
Performing object detection on images.
Extracting text from documents for further processing.

Add to your AI client

Use these steps to connect Multimodal Model Context Protocol Server in Cursor, Claude, VS Code, and other MCP-compatible apps. The same JSON appears in the Use with menu above for one-click copy.

Cursor

Add this to your .cursor/mcp.json file in your project root, then restart Cursor.

.cursor/mcp.json

{
  "mcpServers": {
    "pixeltable-mcp-server-pixeltable": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-pixeltable-mcp-server-pixeltable"
      ]
    }
  }
}

Claude Desktop

Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.

~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)

{
  "mcpServers": {
    "pixeltable-mcp-server-pixeltable": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-pixeltable-mcp-server-pixeltable"
      ]
    }
  }
}

Claude Code

Add this to your project's .mcp.json file. Claude Code will detect it automatically.

.mcp.json (project root)

{
  "mcpServers": {
    "pixeltable-mcp-server-pixeltable": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-pixeltable-mcp-server-pixeltable"
      ]
    }
  }
}

VS Code (Copilot)

Add this to your .vscode/mcp.json file. Requires the GitHub Copilot extension with MCP support enabled.

.vscode/mcp.json

{
  "servers": {
    "pixeltable-mcp-server-pixeltable": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-pixeltable-mcp-server-pixeltable"
      ]
    }
  }
}

Windsurf

Add this to your Windsurf MCP config file, then restart Windsurf.

~/.codeium/windsurf/mcp_config.json

{
  "mcpServers": {
    "pixeltable-mcp-server-pixeltable": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-pixeltable-mcp-server-pixeltable"
      ]
    }
  }
}

Cline

Open Cline settings, navigate to MCP Servers, and add this server configuration.

Cline MCP Settings (via UI)

{
  "mcpServers": {
    "pixeltable-mcp-server-pixeltable": {
      "command": "npx",
      "args": [
        "-y",
        "@modelcontextprotocol/server-pixeltable-mcp-server-pixeltable"
      ]
    }
  }
}

FAQ

What types of data can be indexed?

The server can index audio, video, images, and documents.

How do I run the server locally?

You can run the server locally using Docker by following the installation instructions provided in the documentation.

Is there a community for support?

Yes! You can join the Pixeltable community on Discord for support and discussions.

Research and data