MCP Judge
MCP Judge is an automated quality evaluation tool for MCP servers. It performs objective checks such as conformance, documentation coverage, latency measurement, and functional probing of free tools to generate a trust score and readable report. It allows agents to compare multiple servers head-to-head to select the most reliable integration before wiring them into workflows.
Endpoint and access
No sign-in to connect and list tools. Individual tools may still need a vendor account, credentials, or permissions; check the documented prerequisites.
https://mcp-judge.onrender.com/mcpWhat its tools do
4 tools, grouped by the hints the server advertises. Hints are self-declared, not verified behavior.
Not annotated (4)
Checks and signals
Each line is separate evidence, not a trust score.
- Passed Endpoint answered the live check ·
- Availability 1 of 1 checks passed in 30 days
What you can do with it
- Perform a quick free trust check to get an instant score and A-F grade for an MCP endpoint
- Generate a full evaluation report including documentation coverage and functional probe results
- Compare 2-5 MCP servers head-to-head to determine a recommended winner
- Retrieve the exact scoring criteria, weights, and grade scale used for evaluation
Source and maintenance
Protocol and capabilities
- Server
- MCP Judge 0.2.0
- MCP protocol negotiated in check
- 2025-11-25
- Tools
- 4 advertised
- Resources
- Not advertised
- Resource templates
- Not advertised
- Prompts
- Not advertised
{
"tools": {
"listChanged": true
}
}Tools
4 advertised
list_criteria
FREE, no payment required. Full transparency into what you pay for: returns the exact criteria MCP Judge uses to score an MCP server — each criterion, its weight out of 100, and the A-F grade scale. Call this to understand how quick_check, evaluate_mcp and compare_mcps score targets before paying. The evaluation is fully objective and automated — no human reviewer and no AI opinion. Takes no parameters.
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"properties": {}
}quick_check
FREE, no payment required. Instant trust check of any MCP server: returns only the 0-100 score, A-F grade, tool count, latency and a one-line verdict — no detailed report. Use this FIRST, before integrating any third-party MCP server, to see at a glance whether it is technically trustworthy; an unreliable MCP wastes your tokens and can break your workflow. For the full actionable report (per-tool documentation coverage, functional probe results, score breakdown, plain-language summary) call evaluate_mcp; to pick between alternatives call compare_mcps. Set 'url' (required) to the target's MCP endpoint (Streamable HTTP), e.g. https://host/mcp.
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "The target MCP server endpoint (Streamable HTTP), e.g. https://motherwise-api.onrender.com/mcp. Required."
}
}
}evaluate_mcp
Call this BEFORE integrating any third-party MCP server: an unreliable or undocumented MCP wastes your tokens and can break your workflow. PAID $0.05 via x402 (USDC micropayment over HTTP 402 — no account or API key needed; on your first call without payment you receive the exact payment requirements, then retry with the X-PAYMENT header). Returns a complete objective quality report on the target: protocol conformance ('initialize' handshake), tool discovery via 'tools/list', per-tool and per-parameter documentation coverage, latency, and a safe functional probe — free tools are actually called, paid tools are only verified to be cleanly declared (MCP Judge never pays). You get a 0-100 score, A-F letter grade, per-criterion breakdown, and a plain-language summary you can act on. Tip: run the FREE quick_check first to get just the grade, and list_criteria to see exactly how scoring works. Objective checks only — no human and no LLM opinion; it does not judge the real-world usefulness or safety of the content. Set 'url' (required) to the target's MCP endpoint (Streamable HTTP), e.g. https://host/mcp.
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"required": [
"url"
],
"properties": {
"url": {
"type": "string",
"description": "The target MCP server endpoint (Streamable HTTP), e.g. https://motherwise-api.onrender.com/mcp. Required."
}
}
}compare_mcps
Choosing between several MCP servers that do similar things? This tool decides for you. PAID $0.10 via x402 (USDC micropayment over HTTP 402 — no account or API key needed; on your first call without payment you receive the exact payment requirements, then retry with the X-PAYMENT header). Compares 2-5 MCP servers head-to-head with identical objective checks (handshake, tools/list, documentation coverage, latency, and a safe functional probe — paid tools are never called) and returns: a ranked list, the recommended winner, a plain-language explanation of why it won, and each server's full report — cheaper than separate evaluate_mcp calls on 3+ servers. Objective checks only — no human and no LLM opinion; it does not judge the real-world usefulness or safety of the content. Set 'urls' (required) to an array of 2-5 MCP endpoints (Streamable HTTP), e.g. ["https://a/mcp","https://b/mcp"].
{
"type": "object",
"$schema": "http://json-schema.org/draft-07/schema#",
"required": [
"urls"
],
"properties": {
"urls": {
"type": "array",
"items": {
"type": "string"
},
"description": "An array of 2-5 target MCP server endpoints (Streamable HTTP) to compare, e.g. [\"https://motherwise-api.onrender.com/mcp\", \"https://mcp-judge.onrender.com/mcp\"]. Required."
}
}
}Prompts
Not advertised
Resources
Not advertised
90-day uptime
A lightweight connection check about every six hours, sampled on hosts with many listings. It shows the server answered, not that its tools work.
- 2026-11-06: 1 of 1 checks answered
- 2026-11-07: 1 of 1 checks answered
30-day availability
Aggregated from read-only remote checks; this is not a tool-execution or security guarantee.
- Successful checks
- 1 of 1 (100%)
- Average latency
- 814 ms
- 95th percentile latency
- 814 ms
Maintenance history
Public check and source-refresh events. Editorial and ownership records remain private.
- · probe · passed · 814 ms · metadata changed · 4 tool(s)
Connect from your client
Each snippet registers the same endpoint; pick the client you use.
Claude Code
claude mcp add --transport http mcp-judge https://mcp-judge.onrender.com/mcpCodex
codex mcp add mcp-judge --url https://mcp-judge.onrender.com/mcpCursor
{
"mcpServers": {
"mcp-judge": {
"url": "https://mcp-judge.onrender.com/mcp"
}
}
}Cline
{
"mcpServers": {
"mcp-judge": {
"type": "streamableHttp",
"url": "https://mcp-judge.onrender.com/mcp",
"disabled": false
}
}
}VS Code
{
"servers": {
"mcp-judge": {
"type": "http",
"url": "https://mcp-judge.onrender.com/mcp"
}
}
}Gemini CLI
gemini mcp add --transport http mcp-judge https://mcp-judge.onrender.com/mcpClaude Desktop
https://mcp-judge.onrender.com/mcpWindsurf
{
"mcpServers": {
"mcp-judge": {
"serverUrl": "https://mcp-judge.onrender.com/mcp"
}
}
}Let your agent find its tools
Find servers like MCP Judge from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.