Koskamo

Benchwarmers MCP

A self-hosted panel gateway for LLMs that allows agents to ask a collection of models at once, keeping answers side by side. It supports model routing, code review, and benchmarking by letting verdicts pick the next panel of models.

Package and access

Local package with source-attributed installation metadata. Koskamo does not execute packages during review.

Benchwarmers MCP logo, by WendellResearch-AICommunity listingLocal stdioSource reviewed; not executedPublished by WendellResearch-AI
Vendor documentation

Checks and signals

Each line is separate evidence, not a trust score.

  • Popularity 1 GitHub star

What you can do with it

  • Ask multiple LLMs simultaneously for comparison
  • Perform code review using different models
  • Benchmark models on private projects
  • Route requests to specific model collections

Source and maintenance

Community listingRegistry 0.5.0MIT
mcp-registry: io.github.WendellResearch-AI/benchwarmers@0.5.0Source repositoryProject website
Last repository push
Latest release
v0.5.0
Maintenance checked

Packages and installation

Source-provided package data. Koskamo has not executed or live-probed this package.

benchwarmers 0.5.0

pypiuvx
benchwarmers package definition
{
  "version": "0.5.0",
  "transport": "stdio",
  "identifier": "benchwarmers",
  "runtimeHint": "uvx",
  "registryType": "pypi",
  "packageArguments": [
    {
      "type": "positional",
      "value": "mcp"
    }
  ],
  "environmentVariables": [
    {
      "name": "BENCHWARMERS_URL",
      "description": "Your Benchwarmers server (default http://127.0.0.1:8122)"
    },
    {
      "name": "BENCHWARMERS_KEY",
      "description": "A gateway key, needed beyond this machine or where the server requires keys"
    },
    {
      "name": "BENCHWARMERS_TIMEOUT",
      "description": "Seconds to wait for a panel (default 900)"
    }
  ]
}

Tools

Reported by the attributed source; not independently observed by Koskamo.

No tool definitions available.

Maintenance history

Public check and source-refresh events. Editorial and ownership records remain private.

  • · repository · passed · metadata changed · updated
  • · backfill · recorded · Pre-expansion baseline; unobserved rich metadata remains unknown

Connect from your client

Each snippet configures the same source-provided package; replace placeholders before use.

This server is operated by the named third party. Listing and endpoint checks are not an endorsement or a security audit. Review the operator's permissions, terms, and data handling before connecting. How listings are checked and corrected.

Cursor

Merge this local stdio configuration, replace every placeholder environment value, and restart Cursor. Koskamo has not executed this package.
Cursor configuration
{
  "mcpServers": {
    "benchwarmers-mcp": {
      "command": "uvx",
      "args": [
        "benchwarmers==0.5.0",
        "mcp"
      ],
      "env": {
        "BENCHWARMERS_URL": "<YOUR_BENCHWARMERS_URL>",
        "BENCHWARMERS_KEY": "<YOUR_BENCHWARMERS_KEY>",
        "BENCHWARMERS_TIMEOUT": "<YOUR_BENCHWARMERS_TIMEOUT>"
      }
    }
  }
}

Cline

Merge this local stdio configuration, replace every placeholder environment value, and restart Cline. Koskamo has not executed this package.
Cline configuration
{
  "mcpServers": {
    "benchwarmers-mcp": {
      "command": "uvx",
      "args": [
        "benchwarmers==0.5.0",
        "mcp"
      ],
      "env": {
        "BENCHWARMERS_URL": "<YOUR_BENCHWARMERS_URL>",
        "BENCHWARMERS_KEY": "<YOUR_BENCHWARMERS_KEY>",
        "BENCHWARMERS_TIMEOUT": "<YOUR_BENCHWARMERS_TIMEOUT>"
      }
    }
  }
}

VS Code

Merge this local stdio configuration, replace every placeholder environment value, and restart VS Code. Koskamo has not executed this package.
VS Code configuration
{
  "servers": {
    "benchwarmers-mcp": {
      "type": "stdio",
      "command": "uvx",
      "args": [
        "benchwarmers==0.5.0",
        "mcp"
      ],
      "env": {
        "BENCHWARMERS_URL": "<YOUR_BENCHWARMERS_URL>",
        "BENCHWARMERS_KEY": "<YOUR_BENCHWARMERS_KEY>",
        "BENCHWARMERS_TIMEOUT": "<YOUR_BENCHWARMERS_TIMEOUT>"
      }
    }
  }
}

Claude Desktop

Merge this local stdio configuration, replace every placeholder environment value, and restart Claude Desktop. Koskamo has not executed this package.
Claude Desktop configuration
{
  "mcpServers": {
    "benchwarmers-mcp": {
      "command": "uvx",
      "args": [
        "benchwarmers==0.5.0",
        "mcp"
      ],
      "env": {
        "BENCHWARMERS_URL": "<YOUR_BENCHWARMERS_URL>",
        "BENCHWARMERS_KEY": "<YOUR_BENCHWARMERS_KEY>",
        "BENCHWARMERS_TIMEOUT": "<YOUR_BENCHWARMERS_TIMEOUT>"
      }
    }
  }
}

Let your agent find its tools

Find servers like Benchwarmers MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.

Connect Koskamo Explore workflows
See all 4,469