Web Scraping MCP server

Web Scraping is a remote MCP server that gives an AI agent 3 tools, among them crawl_website, google_search, wikipedia_lookup. It answers at https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp over streamable HTTP, and it listed its tools to an anonymous client, so no sign-in was needed for that. Our probes reached it 10 of 10 times since 5 September 2026; the last check, on 18 October 2026, succeeded.

Status

Answering

Tools

Reliability

10 of 10 checks

Response time

129 ms

Transport

streamable HTTP

Last checked

18 October 2026

Generic URL crawl + HTML extraction — fallback for sites without dedicated MCPs.

Description as the publisher wrote it.

The 3 tools Web Scraping offers

Tool	What it does
`crawl_website`	Crawl a website and extract its content as structured data. Args: url: Website URL to crawl (e.g. 'https://example.com') max_pages: Max pages to crawl (default 5) Inputs: url, max_pages
`google_search`	Search Google and return organic results with titles, URLs, snippets. Args: query: Search query (e.g. 'best python libraries 2026') max_results: Max results (default 10) Inputs: query, max_results
`wikipedia_lookup`	Look up a Wikipedia article and return its content. Args: topic: Topic to look up (e.g. 'Artificial intelligence') Inputs: topic

Add Web Scraping to your AI client

Every block below points at https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp. Pick your client and copy.

Claude Code: one command in your terminal

claude mcp add --transport http web-scraping-mcp-server https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

Claude Desktop: claude_desktop_config.json

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "command": "npx",
      "args": ["-y", "mcp-remote", "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"]
    }
  }
}

Cursor: ~/.cursor/mcp.json, or .cursor/mcp.json in a project

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

VS Code and GitHub Copilot: .vscode/mcp.json

{
  "servers": {
    "web-scraping-mcp-server": {
      "type": "http",
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Zed: Zed settings.json

{
  "context_servers": {
    "web-scraping-mcp-server": {
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Windsurf: ~/.codeium/mcp_config.json

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "serverUrl": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

JetBrains AI Assistant: Settings, Tools, AI Assistant, MCP, New MCP Server, as JSON

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Continue: .continue/mcpServers/neuronto.yaml

name: web-scraping-mcp-server
version: 0.0.1
schema: v1
mcpServers:
  - name: web-scraping-mcp-server
    type: streamable-http
    url: https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp

Gemini CLI: ~/.gemini/settings.json

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "httpUrl": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Codex CLI: MCP server config

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "type": "http",
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Warp: MCP servers, + Add, paste JSON

{
  "mcpServers": {
    "web-scraping-mcp-server": {
      "url": "https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp"
    }
  }
}

Goose: a one-click extension link

goose://extension?url=https%3A%2F%2Fnexgendata-mcp-proxy.steve-corbeil.workers.dev%2Fweb-scraping-mcp-server%2Fmcp&type=streamable_http&id=web-scraping-mcp-server&name=web-scraping-mcp-server

Is Web Scraping up right now?

It answered our last check on 18 October 2026 in 129 ms. Over 10 checks since 5 September 2026 it answered 10. Status here comes from Neuronto's own probes, not from the publisher.

MCP servers similar to Web Scraping

Brainiall Web5 tools Search2 tools Spider Cloud0 tools web-scraper1 tools stagenth · 网页数据4 tools Hydrafetch9 tools

Questions about Web Scraping

How many tools does Web Scraping have?

3, as returned by the server's own tools/list on 31 August 2026: crawl_website, google_search, wikipedia_lookup.

Is Web Scraping down?

It answered our last check on 18 October 2026 in 129 ms. Over 10 checks since 5 September 2026 it answered 10.

How do I add Web Scraping to Cursor?

Put the server under mcpServers in ~/.cursor/mcp.json with the URL https://nexgendata-mcp-proxy.steve-corbeil.workers.dev/web-scraping-mcp-server/mcp. The exact JSON is above, with the same setup for Claude Code, Claude Desktop, VS Code, Windsurf, Zed, Gemini CLI and the rest.

Does Web Scraping need an API key?

It listed its tools to an anonymous client, so reading the tool list needs no key. Individual tools can still ask for credentials in their own inputs.

Where this comes from

Publisher: com.thenextgennexus. Endpoint host: nexgendata-mcp-proxy.steve-corbeil.workers.dev. ARD identifier: urn:air:com.thenextgennexus:mcp:web-scraping-mcp-server. First indexed 31 August 2026. The tools are exactly what the server returned; nothing on this page is inferred from its name. Ranking in Neuronto search is never for sale.

Is this your server? Get a message the day it stops answering or its tools change: monitoring, 14 days free. Or claim the domain to manage how it is listed.