MCP Webscan Server
A Model Context Protocol (MCP) server for web content scanning and analysis. This server provides tools for fetching, analyzing, and extracting information from web pages.
Overview
MCP Webscan Server is a Model Context Protocol (MCP) server designed for web content scanning and analysis, providing tools for fetching, analyzing, and extracting information from web pages.
To use the MCP Webscan Server, install it via Smithery or manually clone the repository, install dependencies, and start the server. You can then use various tools to interact with web content.
- Page Fetching: Convert web pages to Markdown for easy analysis - Link Extraction: Extract and analyze links from web pages - Site Crawling: Recursively crawl websites to discover content - Link Checking: Identify broken links on web pages - Pattern Matching: Find URLs matching specific patterns - Sitemap Generation: Generate XML sitemaps for websites
- Analyzing web content for research purposes
- Checking for broken links on a website
- Generating sitemaps for SEO optimization
- Extracting data from web pages for further analysis
Add to your AI client
Use these steps to connect MCP Webscan Server in Cursor, Claude, VS Code, and other MCP-compatible apps. The same JSON appears in the Use with menu above for one-click copy.
Cursor
Add this to your .cursor/mcp.json file in your project root, then restart Cursor.
.cursor/mcp.json
{
"mcpServers": {
"mcp-server-webscan-bsmi021": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-mcp-server-webscan-bsmi021"
]
}
}
}Claude Desktop
Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.
~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)
{
"mcpServers": {
"mcp-server-webscan-bsmi021": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-mcp-server-webscan-bsmi021"
]
}
}
}Claude Code
Add this to your project's .mcp.json file. Claude Code will detect it automatically.
.mcp.json (project root)
{
"mcpServers": {
"mcp-server-webscan-bsmi021": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-mcp-server-webscan-bsmi021"
]
}
}
}VS Code (Copilot)
Add this to your .vscode/mcp.json file. Requires the GitHub Copilot extension with MCP support enabled.
.vscode/mcp.json
{
"servers": {
"mcp-server-webscan-bsmi021": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-mcp-server-webscan-bsmi021"
]
}
}
}Windsurf
Add this to your Windsurf MCP config file, then restart Windsurf.
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"mcp-server-webscan-bsmi021": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-mcp-server-webscan-bsmi021"
]
}
}
}Cline
Open Cline settings, navigate to MCP Servers, and add this server configuration.
Cline MCP Settings (via UI)
{
"mcpServers": {
"mcp-server-webscan-bsmi021": {
"command": "npx",
"args": [
"-y",
"@modelcontextprotocol/server-mcp-server-webscan-bsmi021"
]
}
}
}FAQ
Can MCP Webscan Server analyze any website?
Yes! It can analyze any publicly accessible website.
Is there a limit to the number of pages I can crawl?
The maximum crawl depth can be set, but there is no strict limit on the number of pages.
How do I report issues or contribute?
You can fork the repository, create a feature branch, and submit a pull request.