Robots Txt Checker MCP server

Connect Robots Txt Checker and your agent gets 1 tool, among them robots_txt_checker. It answers at https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp over streamable HTTP, and it listed its tools to an anonymous client, so no sign-in was needed for that. Our probes reached it 6 of 6 times since 11 September 2026; the last check, on 23 October 2026, succeeded.

Checks if a URL path is allowed by robots.txt. x402 payment required (Base mainnet USDC).

Description as the publisher wrote it.

The 1 tool Robots Txt Checker offers

Add Robots Txt Checker to your AI client

Every block below points at https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp. Pick your client and copy.

claude mcp add --transport http robots-txt-checker https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp

{
  "mcpServers": {
    "robots-txt-checker": {
      "command": "npx",
      "args": ["-y", "mcp-remote", "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"]
    }
  }
}

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "servers": {
    "robots-txt-checker": {
      "type": "http",
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "context_servers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "mcpServers": {
    "robots-txt-checker": {
      "serverUrl": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

name: Robots Txt Checker
version: 0.0.1
schema: v1
mcpServers:
  - name: Robots Txt Checker
    type: streamable-http
    url: https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp

{
  "mcpServers": {
    "robots-txt-checker": {
      "httpUrl": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "mcpServers": {
    "robots-txt-checker": {
      "type": "http",
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

{
  "mcpServers": {
    "robots-txt-checker": {
      "url": "https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp"
    }
  }
}

goose://extension?url=https%3A%2F%2Fai-factory-mcp.ryuamarines.workers.dev%2Frobots-txt-checker%2Fmcp&type=streamable_http&id=robots-txt-checker&name=Robots%20Txt%20Checker

Is Robots Txt Checker up right now?

It answered our last check on 23 October 2026 in 535 ms. Over 6 checks since 11 September 2026 it answered 6. Status here comes from Neuronto's own probes, not from the publisher.

MCP servers similar to Robots Txt Checker

Questions about Robots Txt Checker

How many tools does Robots Txt Checker have?

1, as returned by the server's own tools/list on 20 September 2026: robots_txt_checker.

Is Robots Txt Checker down?

It answered our last check on 23 October 2026 in 535 ms. Over 6 checks since 11 September 2026 it answered 6.

How do I add Robots Txt Checker to Cursor?

Put the server under mcpServers in ~/.cursor/mcp.json with the URL https://ai-factory-mcp.ryuamarines.workers.dev/robots-txt-checker/mcp. The exact JSON is above, with the same setup for Claude Code, Claude Desktop, VS Code, Windsurf, Zed, Gemini CLI and the rest.

Does Robots Txt Checker need an API key?

It listed its tools to an anonymous client, so reading the tool list needs no key. Individual tools can still ask for credentials in their own inputs.

Where this comes from

Publisher: io.github.ryuamarines. Endpoint host: ai-factory-mcp.ryuamarines.workers.dev. ARD identifier: urn:air:io.github.ryuamarines:mcp:robots-txt-checker. First indexed 10 September 2026. The tools are exactly what the server returned; nothing on this page is inferred from its name. Ranking in Neuronto search is never for sale.