Open-source web scraper for AI agents with scrape, crawl, and map tools
Use this profile to copy client config, check auth requirements, review tools and resources, and compare related MCP servers before adding it to an AI client.
Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.
{
"mcpServers": {
"io-github-us-crw": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-io-github-us-crw"
]
}
}
}~/Library/Application Support/Claude/claude_desktop_config.json%APPDATA%\Claude\claude_desktop_config.jsonNo remote HTTP endpoint is advertised. Use the package or stdio setup shown in Install.
CRW Web Scraper is an MCP server for Open-source web scraper for AI agents with scrape, crawl, and map tools. It supports STDIO transport.
Use the client-specific config in Install and add it to your MCP-compatible client.
Choose the Claude Desktop tab in Install and copy the config into Claude Desktop's MCP server settings.
Choose the Claude Code tab in Install and copy the config into Claude Code's MCP server settings.
Choose the Codex tab in Install and copy the config into Codex's MCP server settings.
Choose the Cursor or VS Code tab in Install and copy the config into Cursor or VS Code's MCP server settings.
CRW Web Scraper uses STDIO transport. Use the package or command config in Install.
CRW Web Scraper inventory is listed when the MCP endpoint exposes tools, resources, or prompts. Some servers require auth first.
CRW Web Scraper does not advertise a verified auth requirement. If discovery fails, it may still need provider login, an API key, a bearer token, or a session header.
| Package | Registry | Version | Inputs |
|---|---|---|---|
ghcr.io/us/crw:lateststdio | oci | Not captured | None advertised |