Index / MCP servers / Nonobench

Nonobench MCP server

Nonobench is an MCP server with 11 tools an agent can call, among them check_solution, compare_models, get_leaderboard. It answers at https://www.nonobench.com/mcp over streamable HTTP, and it listed its tools to an anonymous client, so no sign-in was needed for that. Our probes reached it 4 of 4 times since 30 September 2026; the last check, on 16 November 2026, succeeded.

Status
Answering
Tools
11
Reliability
4 of 4 checks
Response time
272 ms
Transport
streamable HTTP
Last checked
16 November 2026

An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.

Description as the publisher wrote it.

The 11 tools Nonobench offers

ToolWhat it does
check_solutionCheck a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match.
Inputs: id, grid
compare_modelsSide-by-side core overall and per-size accuracy, cost, latency and token results for model or family names.
Inputs: models
get_leaderboardModels ranked by accuracy; defaults to all effort levels for compatibility.
Inputs: size, provider, family, version, effort, reasoning
get_model_puzzlesWhich puzzles one model solved, missed, timed out on, or has not run.
Inputs: model
get_model_resultsAccuracy, cost, latency and token use for one model, broken down by grid size.
Inputs: model
get_puzzleOne puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions.
Inputs: id, include_solution
get_puzzle_resultsPer-model outcomes for one puzzle. Answers are omitted unless requested.
Inputs: id, provider, family, effort, reasoning, open_weights
list_familiesModel families, available efforts and best variants.
list_providersProvider ids, names, families and variant counts.
list_puzzlesThe benchmark puzzles with their ids and row/column clues.
Inputs: size
list_runsIndividual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output.
Inputs: model, puzzle_id, size, include_output, limit, offset

Add Nonobench to your AI client

Every block below points at https://www.nonobench.com/mcp. Pick your client and copy.

Claude Code: one command in your terminal
claude mcp add --transport http nonobench https://www.nonobench.com/mcp
Claude Desktop: claude_desktop_config.json
{
  "mcpServers": {
    "nonobench": {
      "command": "npx",
      "args": ["-y", "mcp-remote", "https://www.nonobench.com/mcp"]
    }
  }
}
Cursor: ~/.cursor/mcp.json, or .cursor/mcp.json in a project
{
  "mcpServers": {
    "nonobench": {
      "url": "https://www.nonobench.com/mcp"
    }
  }
}
VS Code and GitHub Copilot: .vscode/mcp.json
{
  "servers": {
    "nonobench": {
      "type": "http",
      "url": "https://www.nonobench.com/mcp"
    }
  }
}
Zed: Zed settings.json
{
  "context_servers": {
    "nonobench": {
      "url": "https://www.nonobench.com/mcp"
    }
  }
}
Windsurf: ~/.codeium/mcp_config.json
{
  "mcpServers": {
    "nonobench": {
      "serverUrl": "https://www.nonobench.com/mcp"
    }
  }
}
JetBrains AI Assistant: Settings, Tools, AI Assistant, MCP, New MCP Server, as JSON
{
  "mcpServers": {
    "nonobench": {
      "url": "https://www.nonobench.com/mcp"
    }
  }
}
Continue: .continue/mcpServers/neuronto.yaml
name: Nonobench
version: 0.0.1
schema: v1
mcpServers:
  - name: Nonobench
    type: streamable-http
    url: https://www.nonobench.com/mcp
Gemini CLI: ~/.gemini/settings.json
{
  "mcpServers": {
    "nonobench": {
      "httpUrl": "https://www.nonobench.com/mcp"
    }
  }
}
Codex CLI: MCP server config
{
  "mcpServers": {
    "nonobench": {
      "type": "http",
      "url": "https://www.nonobench.com/mcp"
    }
  }
}
Warp: MCP servers, + Add, paste JSON
{
  "mcpServers": {
    "nonobench": {
      "url": "https://www.nonobench.com/mcp"
    }
  }
}
Goose: a one-click extension link
goose://extension?url=https%3A%2F%2Fwww.nonobench.com%2Fmcp&type=streamable_http&id=nonobench&name=Nonobench

Is Nonobench up right now?

It answered our last check on 16 November 2026 in 272 ms. Over 4 checks since 30 September 2026 it answered 4. Status here comes from Neuronto's own probes, not from the publisher.

MCP servers similar to Nonobench

Questions about Nonobench

How many tools does Nonobench have?

11, as returned by the server's own tools/list on 18 November 2026: check_solution, compare_models, get_leaderboard, get_model_puzzles, get_model_results, get_puzzle, get_puzzle_results, list_families, and 3 more.

Is Nonobench down?

It answered our last check on 16 November 2026 in 272 ms. Over 4 checks since 30 September 2026 it answered 4.

How do I add Nonobench to Cursor?

Put the server under mcpServers in ~/.cursor/mcp.json with the URL https://www.nonobench.com/mcp. The exact JSON is above, with the same setup for Claude Code, Claude Desktop, VS Code, Windsurf, Zed, Gemini CLI and the rest.

Does Nonobench need an API key?

It listed its tools to an anonymous client, so reading the tool list needs no key. Individual tools can still ask for credentials in their own inputs.

Where this comes from

Publisher: io.github.mauricekleine. Endpoint host: www.nonobench.com. ARD identifier: urn:air:io.github.mauricekleine:mcp:nonobench. First indexed 30 September 2026. The tools are exactly what the server returned; nothing on this page is inferred from its name. Ranking in Neuronto search is never for sale.

Is this your server? Get a message the day it stops answering or its tools change: monitoring, 14 days free. Or claim the domain to manage how it is listed.