Connect Robots.txt Policy Lint and your agent gets 9 tools, among them am_i_allowed, audit_ai_access, check_path_allowed. It answers at https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots over streamable HTTP, and it listed its tools to an anonymous client, so no sign-in was needed for that. Our probes reached it 6 of 6 times since 10 September 2026; the last check, on 19 October 2026, succeeded.
{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key
Description as the publisher wrote it.
| Tool | What it does |
|---|---|
am_i_allowed | {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"am_i_allowed","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/robots and the answer is what this host's own robots.txt says to YOU — the group t |
audit_ai_access | FIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} — Evaluate a pasted robots.txt against every AI crawler in this index and return the two li Inputs: robots_txt, path |
check_path_allowed | FIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} — Evaluate a pasted robots.txt for one crawler and one or more paths under RFC 9309: longes Inputs: robots_txt, user_agent, paths |
diff_robots_txt | FIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} — Compare two versions of a robots.txt and report only the crawlers whose verdict actually Inputs: before, after, path |
example | {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"example","arguments":{}}} — POST that exact body to https://www.pathwren.workers.dev/mcp/robots and you are done: free, read-only, no API key, no account, no consent prompt, no |
lint_robots_txt | FIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} — Parse a robots.txt you paste and report every fault that makes it do something other than Inputs: robots_txt |
merge_policy | FIRST CALL, needs nothing: {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} — Merge one of eight maintained robots.txt stances (block-ai-training, allow-ai-search-only Inputs: robots_txt, stance |
no_arguments_lint_this_hosts_robots_txt | TAKES NO ARGUMENTS. POST {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"no_arguments_lint_this_hosts_robots_txt","arguments":{}}} to https://www.pathwren.workers.dev/mcp/robots — the answer is the full RFC 9309 lint of this |
whoami | {"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} — POST that to https://www.pathwren.workers.dev/mcp/robots and the answer is the user-agent you sent, the class this host's own instrument books it as, |
Every block below points at https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots. Pick your client and copy.
claude mcp add --transport http robots-txt-policy-lint https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots
{
"mcpServers": {
"robots-txt-policy-lint": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"]
}
}
}{
"mcpServers": {
"robots-txt-policy-lint": {
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}{
"servers": {
"robots-txt-policy-lint": {
"type": "http",
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}{
"context_servers": {
"robots-txt-policy-lint": {
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}{
"mcpServers": {
"robots-txt-policy-lint": {
"serverUrl": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}{
"mcpServers": {
"robots-txt-policy-lint": {
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}name: Robots.txt Policy Lint
version: 0.0.1
schema: v1
mcpServers:
- name: Robots.txt Policy Lint
type: streamable-http
url: https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots{
"mcpServers": {
"robots-txt-policy-lint": {
"httpUrl": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}{
"mcpServers": {
"robots-txt-policy-lint": {
"type": "http",
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}{
"mcpServers": {
"robots-txt-policy-lint": {
"url": "https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots"
}
}
}goose://extension?url=https%3A%2F%2Fwww.pathwren.workers.dev%2Fc%2Fmcp-registry-official%2Fmcp%2Frobots&type=streamable_http&id=robots-txt-policy-lint&name=Robots.txt%20Policy%20Lint
It answered our last check on 19 October 2026 in 176 ms. Over 6 checks since 10 September 2026 it answered 6. Status here comes from Neuronto's own probes, not from the publisher.
9, as returned by the server's own tools/list on 11 September 2026: am_i_allowed, audit_ai_access, check_path_allowed, diff_robots_txt, example, lint_robots_txt, merge_policy, no_arguments_lint_this_hosts_robots_txt, and 1 more.
It answered our last check on 19 October 2026 in 176 ms. Over 6 checks since 10 September 2026 it answered 6.
Put the server under mcpServers in ~/.cursor/mcp.json with the URL https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots. The exact JSON is above, with the same setup for Claude Code, Claude Desktop, VS Code, Windsurf, Zed, Gemini CLI and the rest.
It listed its tools to an anonymous client, so reading the tool list needs no key. Individual tools can still ask for credentials in their own inputs.
Publisher: dev.workers.pathwren.www. Endpoint host: www.pathwren.workers.dev. ARD identifier: urn:air:dev.workers.pathwren.www:mcp:robots-policy-lint.
First indexed 10 September 2026. The tools are exactly what the server returned; nothing on this page
is inferred from its name. Ranking in Neuronto search is never for sale.