Nonobench is an MCP server with 11 tools an agent can call, among them check_solution, compare_models, get_leaderboard. It answers at https://www.nonobench.com/mcp over streamable HTTP, and it listed its tools to an anonymous client, so no sign-in was needed for that. Our probes reached it 4 of 4 times since 30 September 2026; the last check, on 16 November 2026, succeeded.
An open-source benchmark of how well LLMs solve nonogram puzzles, from 5x5 to 20x20.
Description as the publisher wrote it.
| Tool | What it does |
|---|---|
check_solution | Check a grid against a puzzle's clues, using the same rule as the benchmark grader. Reports which rows and columns do not match. Inputs: id, grid |
compare_models | Side-by-side core overall and per-size accuracy, cost, latency and token results for model or family names. Inputs: models |
get_leaderboard | Models ranked by accuracy; defaults to all effort levels for compatibility. Inputs: size, provider, family, version, effort, reasoning |
get_model_puzzles | Which puzzles one model solved, missed, timed out on, or has not run. Inputs: model |
get_model_results | Accuracy, cost, latency and token use for one model, broken down by grid size. Inputs: model |
get_puzzle | One puzzle, including the clue text models were prompted with. The reference solution is only included on request; some puzzles have several valid solutions. Inputs: id, include_solution |
get_puzzle_results | Per-model outcomes for one puzzle. Answers are omitted unless requested. Inputs: id, provider, family, effort, reasoning, open_weights |
list_families | Model families, available efforts and best variants. |
list_providers | Provider ids, names, families and variant counts. |
list_puzzles | The benchmark puzzles with their ids and row/column clues. Inputs: size |
list_runs | Individual benchmark runs (one model on one puzzle), optionally with the raw prompt and model output. Inputs: model, puzzle_id, size, include_output, limit, offset |
Every block below points at https://www.nonobench.com/mcp. Pick your client and copy.
claude mcp add --transport http nonobench https://www.nonobench.com/mcp
{
"mcpServers": {
"nonobench": {
"command": "npx",
"args": ["-y", "mcp-remote", "https://www.nonobench.com/mcp"]
}
}
}{
"mcpServers": {
"nonobench": {
"url": "https://www.nonobench.com/mcp"
}
}
}{
"servers": {
"nonobench": {
"type": "http",
"url": "https://www.nonobench.com/mcp"
}
}
}{
"context_servers": {
"nonobench": {
"url": "https://www.nonobench.com/mcp"
}
}
}{
"mcpServers": {
"nonobench": {
"serverUrl": "https://www.nonobench.com/mcp"
}
}
}{
"mcpServers": {
"nonobench": {
"url": "https://www.nonobench.com/mcp"
}
}
}name: Nonobench
version: 0.0.1
schema: v1
mcpServers:
- name: Nonobench
type: streamable-http
url: https://www.nonobench.com/mcp{
"mcpServers": {
"nonobench": {
"httpUrl": "https://www.nonobench.com/mcp"
}
}
}{
"mcpServers": {
"nonobench": {
"type": "http",
"url": "https://www.nonobench.com/mcp"
}
}
}{
"mcpServers": {
"nonobench": {
"url": "https://www.nonobench.com/mcp"
}
}
}goose://extension?url=https%3A%2F%2Fwww.nonobench.com%2Fmcp&type=streamable_http&id=nonobench&name=Nonobench
It answered our last check on 16 November 2026 in 272 ms. Over 4 checks since 30 September 2026 it answered 4. Status here comes from Neuronto's own probes, not from the publisher.
11, as returned by the server's own tools/list on 18 November 2026: check_solution, compare_models, get_leaderboard, get_model_puzzles, get_model_results, get_puzzle, get_puzzle_results, list_families, and 3 more.
It answered our last check on 16 November 2026 in 272 ms. Over 4 checks since 30 September 2026 it answered 4.
Put the server under mcpServers in ~/.cursor/mcp.json with the URL https://www.nonobench.com/mcp. The exact JSON is above, with the same setup for Claude Code, Claude Desktop, VS Code, Windsurf, Zed, Gemini CLI and the rest.
It listed its tools to an anonymous client, so reading the tool list needs no key. Individual tools can still ask for credentials in their own inputs.
Publisher: io.github.mauricekleine. Endpoint host: www.nonobench.com. ARD identifier: urn:air:io.github.mauricekleine:mcp:nonobench.
First indexed 30 September 2026. The tools are exactly what the server returned; nothing on this page
is inferred from its name. Ranking in Neuronto search is never for sale.