Overview
MCP Webscan Server is a Model Context Protocol (MCP) server designed for web content scanning and analysis, providing tools for fetching, analyzing, and extracting information from web pages.
To use the MCP Webscan Server, clone the repository, install dependencies, and start the server. You can then utilize various tools to fetch pages, extract links, crawl sites, check links, find patterns, and generate sitemaps.
- Page Fetching: Convert web pages to Markdown for easy analysis - Link Extraction: Extract and analyze links from web pages - Site Crawling: Recursively crawl websites to discover content - Link Checking: Identify broken links on web pages - Pattern Matching: Find URLs matching specific patterns - Sitemap Generation: Generate XML sitemaps for websites
- Analyzing web content for research purposes
- Checking for broken links on websites
- Generating sitemaps for SEO optimization
- Extracting specific data from web pages for data analysis
Add to your AI client
Use these steps to connect MCP Webscan Server in Cursor, Claude, VS Code, and other MCP-compatible apps. The same JSON appears in the Use with menu above for one-click copy.
Cursor
Add this to your .cursor/mcp.json file in your project root, then restart Cursor.
.cursor/mcp.json
{
"mcpServers": {
"bsmi021-mcp-server-webscan-mcp-mirror": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-bsmi021-mcp-server-webscan-mcp-mirror"
]
}
}
}Claude Desktop
Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.
~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)
{
"mcpServers": {
"bsmi021-mcp-server-webscan-mcp-mirror": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-bsmi021-mcp-server-webscan-mcp-mirror"
]
}
}
}Claude Code
Add this to your project's .mcp.json file. Claude Code will detect it automatically.
.mcp.json (project root)
{
"mcpServers": {
"bsmi021-mcp-server-webscan-mcp-mirror": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-bsmi021-mcp-server-webscan-mcp-mirror"
]
}
}
}VS Code (Copilot)
Add this to your .vscode/mcp.json file. Requires the GitHub Copilot extension with MCP support enabled.
.vscode/mcp.json
{
"servers": {
"bsmi021-mcp-server-webscan-mcp-mirror": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-bsmi021-mcp-server-webscan-mcp-mirror"
]
}
}
}Windsurf
Add this to your Windsurf MCP config file, then restart Windsurf.
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"bsmi021-mcp-server-webscan-mcp-mirror": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-bsmi021-mcp-server-webscan-mcp-mirror"
]
}
}
}Cline
Open Cline settings, navigate to MCP Servers, and add this server configuration.
Cline MCP Settings (via UI)
{
"mcpServers": {
"bsmi021-mcp-server-webscan-mcp-mirror": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-bsmi021-mcp-server-webscan-mcp-mirror"
]
}
}
}FAQ
What is the main purpose of MCP Webscan Server?
The main purpose is to provide tools for web content analysis and information extraction.
Is MCP Webscan Server free to use?
Yes! It is open-source and free to use.
What technologies are required to run MCP Webscan Server?
You need Node.js and npm to run the server.7:["$","div",null,{"className":"container mx-auto flex flex-col gap-4","children":["$L26","$L27",["$","$L28",null,{"currentProject":{"id":1027,"uuid":"dd426213-75e1-4510-9851-92997f94be9c","name":"bsmi021_mcp-server-webscan","title":"MCP Webscan Server","description":"Mirror of","avatar_url":"https://avatars.githubusercontent.com/u/192820360?v=4","created_at":"$D2025-01-28T02:26:55.958Z","updated_at":"$D2025-02-23T07:19:43.090Z","status":"created","author_name":"MCP-Mirror","author_avatar_url":"https://avatars.githubusercontent.com/u/192820360?v=4","tags":"mcp,webscan,server,content-analysis","category":"research-and-data","is_featured":false,"sort":1,"url":"https://github.com/MCP-Mirror/bsmi021_mcp-server-webscan","target":"_self","content":"$29","summary":"$2a","img_url":null,"type":null,"metadata":null,"user_uuid":null,"tools":null,"sse_url":null,"sse_provider":null,"sse_params":null,"is_official":false,"server_command":null,"server_params":null,"server_config":null,"allow_call":false,"is_innovation":false,"is_dxt":false,"dxt_manifest":null,"dxt_file_url":null,"is_audit":false},"randomProjects":[],"currentServerKey":"$undefined"}]]}]