olostep-mcp
Search Google, scrape webpage and retrieve content in markdown.
Overview
Olostep MCP Server is a powerful web scraping API that allows users to search the web and scrape content while avoiding bot detection and IP blocking.
To use the Olostep MCP Server, install and run it using the command: env OLOSTEP_API_KEY= npx -y olostep-mcp. You can then utilize its various tools to scrape web content.
- Retrieves webpage content in markdown format. - Provides a website map sorted by relevance to a search query. - Fetches structured data from Google search results using the SERP API.
- Extracting content from various websites for data analysis.
- Mapping website URLs based on specific search queries.
- Gathering structured data from Google search results for research purposes.
Add to your AI client
Use these steps to connect olostep-mcp in Cursor, Claude, VS Code, and other MCP-compatible apps. The same JSON appears in the Use with menu above for one-click copy.
Cursor
Add this to your .cursor/mcp.json file in your project root, then restart Cursor.
.cursor/mcp.json
{
"mcpServers": {
"olostep-mcp-server-olostep": {
"command": "npx",
"args": [
"-y",
"olostep-mcp"
],
"env": {
"OLOSTEP_API_KEY": "YOUR_API_KEY_HERE"
}
}
}
}Claude Desktop
Add this server entry to the mcpServers object in your Claude Desktop config, then restart the app.
~/Library/Application Support/Claude/claude_desktop_config.json (macOS) or %APPDATA%\Claude\claude_desktop_config.json (Windows)
{
"mcpServers": {
"olostep-mcp-server-olostep": {
"command": "npx",
"args": [
"-y",
"olostep-mcp"
],
"env": {
"OLOSTEP_API_KEY": "YOUR_API_KEY_HERE"
}
}
}
}Claude Code
Add this to your project's .mcp.json file. Claude Code will detect it automatically.
.mcp.json (project root)
{
"mcpServers": {
"olostep-mcp-server-olostep": {
"command": "npx",
"args": [
"-y",
"olostep-mcp"
],
"env": {
"OLOSTEP_API_KEY": "YOUR_API_KEY_HERE"
}
}
}
}VS Code (Copilot)
Add this to your .vscode/mcp.json file. Requires the GitHub Copilot extension with MCP support enabled.
.vscode/mcp.json
{
"servers": {
"olostep-mcp-server-olostep": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"olostep-mcp"
],
"env": {
"OLOSTEP_API_KEY": "YOUR_API_KEY_HERE"
}
}
}
}Windsurf
Add this to your Windsurf MCP config file, then restart Windsurf.
~/.codeium/windsurf/mcp_config.json
{
"mcpServers": {
"olostep-mcp-server-olostep": {
"command": "npx",
"args": [
"-y",
"olostep-mcp"
],
"env": {
"OLOSTEP_API_KEY": "YOUR_API_KEY_HERE"
}
}
}
}Cline
Open Cline settings, navigate to MCP Servers, and add this server configuration.
Cline MCP Settings (via UI)
{
"mcpServers": {
"olostep-mcp-server-olostep": {
"command": "npx",
"args": [
"-y",
"olostep-mcp"
],
"env": {
"OLOSTEP_API_KEY": "YOUR_API_KEY_HERE"
}
}
}
}FAQ
Is the Olostep MCP Server free to use?
The documentation does not specify pricing, so check the GitHub page for more details.
What programming languages can I use with the Olostep MCP Server?
The server is compatible with all major AI coding assistants, making it versatile for various programming environments.
How does the server avoid bot detection?
The server employs techniques to mimic human behavior, thus reducing the chances of detection.7:["$","div",null,{"className":"container mx-auto flex flex-col gap-4","children":["$L26","$L27",["$","$L28",null,{"currentProject":{"id":2359,"uuid":"a0184486-7951-409b-8e43-eb555e1941d0","name":"olostep-mcp-server","title":"olostep-mcp","description":"Search Google, scrape webpage and retrieve content in markdown.","avatar_url":"https://www.olostep.com/images/olostep_logo.png","created_at":"2025-03-13T05:57:30.521Z","updated_at":"2025-03-13T06:02:34.630Z","status":"created","author_name":"Olostep","author_avatar_url":null,"tags":"web-scraping,content-extraction,AI-assistants","category":"developer-tools","is_featured":false,"sort":1,"url":"https://github.com/olostep/olostep-mcp-server","target":"_self","content":"$29","summary":"$2a","img_url":null,"type":null,"metadata":null,"user_uuid":"c0cac59f-18cc-4586-b4c6-82c9d584fe06","tools":null,"sse_url":null,"sse_provider":null,"sse_params":null,"is_official":false,"server_command":null,"server_params":null,"server_config":null,"allow_call":false,"is_innovation":false,"is_dxt":false,"dxt_manifest":null,"dxt_file_url":null,"is_audit":false},"randomProjects":[],"currentServerKey":"$undefined"}]]}]