EvalView MCP
EvalView provides regression testing for AI agents by snapshotting behavior, diffing tool calls, and catching regressions in CI. It works with LangGraph, CrewAI, OpenAI, and Anthropic, allowing users to record agent baselines and detect changes in tool usage or output quality.
Package and access
Local package with source-attributed installation metadata. Koskamo does not execute packages during review.
What you can do with it
- Snapshot agent behavior as a baseline
- Diff tool calls and parameters against baseline
- Catch regressions in CI/CD pipelines
- Verify agent output quality with LLM judge
Source and maintenance
- Maintenance checked
Packages and installation
Source-provided package data. Koskamo has not executed or live-probed this package.
evalview 0.6.0
{
"version": "0.6.0",
"transport": "stdio",
"identifier": "evalview",
"registryType": "pypi",
"environmentVariables": [
{
"name": "OPENAI_API_KEY",
"format": "string",
"description": "OpenAI API key for LLM-as-judge output quality scoring. Optional — deterministic tool/sequence evaluation works without it."
}
]
}Tools
Reported by the attributed source; not independently observed by Koskamo.
Connect from your client
Each snippet configures the same source-provided package; replace placeholders before use.
Cursor
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview==0.6.0"
],
"env": {
"OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>"
}
}
}
}Cline
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview==0.6.0"
],
"env": {
"OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>"
}
}
}
}VS Code
{
"servers": {
"evalview-mcp": {
"type": "stdio",
"command": "uvx",
"args": [
"evalview==0.6.0"
],
"env": {
"OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>"
}
}
}
}Claude Desktop
{
"mcpServers": {
"evalview-mcp": {
"command": "uvx",
"args": [
"evalview==0.6.0"
],
"env": {
"OPENAI_API_KEY": "<YOUR_OPENAI_API_KEY>"
}
}
}
}Let your agent find its tools
Find servers like EvalView MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.