Koskamo

Submit AI-generated votes to rankings

Programmatically submit pairwise comparisons or votes to AimRank competitions using AI judgments, automatically updating entity ratings and domain rankings.

How it works

Changes data in your accountsData and analysis

The agent uses the AimRank MCP server with an API key to access write-enabled tools. It identifies a competition or open voting session within a domain. It retrieves the next matchup or selects two entities to compare. The agent performs the comparison (e.g., evaluating two AI model outputs) and submits the vote using the aimrank_submit_vote tool. It confirms the vote was recorded and checks the updated ranking or confidence intervals to ensure the data was processed correctly. This enables scalable, automated evaluation pipelines.

Prompt

Paste this into an agent that has the servers below connected. Adjust the names and dates to your own.

Prompt for Submit AI-generated votes to rankings
Compare the outputs of 'Model A' and 'Model B' in the 'Code-Generation' domain competition and submit a vote if Model A is better.

MCP servers it needs

Source

The vendor page this playbook is drawn from, and the passage that supports it.

All 56 tools, including voting and creating.
Help & Documentation | AimRank

Each playbook is drawn from the vendor page it cites and reviewed by Koskamo before it is published. Koskamo does not run these servers or your agent: check what each tool will do before you let it act on your accounts.