Koskamo

LLMTest MCP

An MCP server that integrates with LLMTest to benchmark AI models on actual prompts, identify cheaper and faster alternatives across 340+ models, and manage optimization features like autopilot and prompt rewriting for agents using Claude Code, Cursor, or Windsurf.

Package and access

Local package with source-attributed installation metadata. Koskamo does not execute packages during review.

LLMTest MCP logo, by tjacquessonCommunity listingLocal stdioSource reviewed; not executedPublished by tjacquesson
You need:Sign up at llmtest.io and grab your API key from the dashboard
Vendor documentation

What you can do with it

  • Benchmark AI models on real prompts
  • Find cheaper alternatives across 340+ models
  • Rewrite prompts to find cheaper working models
  • Enable autopilot for weekly auto-optimization

Source and maintenance

Community listingRegistry 0.6.1MIT
mcp-registry: io.github.tjacquesson/llmtest-mcp@0.6.1Source repositoryProject website
Last repository push
Maintenance checked

Packages and installation

Source-provided package data. Koskamo has not executed or live-probed this package.

llmtest-mcp 0.6.1

npm
llmtest-mcp package definition
{
  "version": "0.6.1",
  "transport": "stdio",
  "identifier": "llmtest-mcp",
  "registryType": "npm",
  "environmentVariables": [
    {
      "name": "LLMTEST_API_KEY",
      "isRequired": true,
      "description": "Your LLMTest API key from https://llmtest.io/dashboard"
    }
  ]
}

Tools

Reported by the attributed source; not independently observed by Koskamo.

No tool definitions available.

Maintenance history

Public check and source-refresh events. Editorial and ownership records remain private.

  • · repository · passed · metadata changed · updated
  • · backfill · recorded · Pre-expansion baseline; unobserved rich metadata remains unknown

Connect from your client

Each snippet configures the same source-provided package; replace placeholders before use.

This server is operated by the named third party. Listing and endpoint checks are not an endorsement or a security audit. Review the operator's permissions, terms, and data handling before connecting. How listings are checked and corrected.

Cursor

Merge this local stdio configuration, replace every placeholder environment value, and restart Cursor. Koskamo has not executed this package.
Cursor configuration
{
  "mcpServers": {
    "llmtest-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "llmtest-mcp@0.6.1"
      ],
      "env": {
        "LLMTEST_API_KEY": "<YOUR_LLMTEST_API_KEY>"
      }
    }
  }
}

Cline

Merge this local stdio configuration, replace every placeholder environment value, and restart Cline. Koskamo has not executed this package.
Cline configuration
{
  "mcpServers": {
    "llmtest-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "llmtest-mcp@0.6.1"
      ],
      "env": {
        "LLMTEST_API_KEY": "<YOUR_LLMTEST_API_KEY>"
      }
    }
  }
}

VS Code

Merge this local stdio configuration, replace every placeholder environment value, and restart VS Code. Koskamo has not executed this package.
VS Code configuration
{
  "servers": {
    "llmtest-mcp": {
      "type": "stdio",
      "command": "npx",
      "args": [
        "-y",
        "llmtest-mcp@0.6.1"
      ],
      "env": {
        "LLMTEST_API_KEY": "<YOUR_LLMTEST_API_KEY>"
      }
    }
  }
}

Claude Desktop

Merge this local stdio configuration, replace every placeholder environment value, and restart Claude Desktop. Koskamo has not executed this package.
Claude Desktop configuration
{
  "mcpServers": {
    "llmtest-mcp": {
      "command": "npx",
      "args": [
        "-y",
        "llmtest-mcp@0.6.1"
      ],
      "env": {
        "LLMTEST_API_KEY": "<YOUR_LLMTEST_API_KEY>"
      }
    }
  }
}

Let your agent find its tools

Find servers like LLMTest MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.

Connect Koskamo Explore workflows
See all 5,640