evalsnap MCP
evalsnap is a community MCP server that diffs two evaluation snapshots of agent and tool outputs. It matches cases by ID, reports changes, score regressions, and provides a pass/fail verdict based on whether any score decreased. It operates locally with no network calls.
Package and access
Local package with source-attributed installation metadata. Koskamo does not execute packages during review.
What you can do with it
- Diff two evaluation snapshots to identify changed cases
- Detect score regressions in agent outputs
- Generate pass/fail verdicts based on regression flags
Source and maintenance
- Maintenance checked
Packages and installation
Source-provided package data. Koskamo has not executed or live-probed this package.
ghcr.io/cloudcorprecords/evalsnap:0.1.0
{
"transport": "stdio",
"identifier": "ghcr.io/cloudcorprecords/evalsnap:0.1.0",
"runtimeHint": "docker",
"registryType": "oci",
"packageArguments": [
{
"type": "positional",
"value": "mcp"
}
],
"runtimeArguments": [
{
"name": "--rm",
"type": "named"
},
{
"name": "-i",
"type": "named"
}
]
}Tools
Reported by the attributed source; not independently observed by Koskamo.
Connect from your client
Each snippet configures the same source-provided package; replace placeholders before use.
Cursor
{
"mcpServers": {
"evalsnap-mcp-0-1-0": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"ghcr.io/cloudcorprecords/evalsnap:0.1.0",
"mcp"
]
}
}
}Cline
{
"mcpServers": {
"evalsnap-mcp-0-1-0": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"ghcr.io/cloudcorprecords/evalsnap:0.1.0",
"mcp"
]
}
}
}VS Code
{
"servers": {
"evalsnap-mcp-0-1-0": {
"type": "stdio",
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"ghcr.io/cloudcorprecords/evalsnap:0.1.0",
"mcp"
]
}
}
}Claude Desktop
{
"mcpServers": {
"evalsnap-mcp-0-1-0": {
"command": "docker",
"args": [
"run",
"-i",
"--rm",
"ghcr.io/cloudcorprecords/evalsnap:0.1.0",
"mcp"
]
}
}
}Let your agent find its tools
Find servers like evalsnap MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.