Automatically dispatches AI requests to the most cost-effective and available provider, reducing inference costs while maintaining service reliability through real-time status checks.
The agent calls the cheapest_model tool with specific context window and operational constraints. It analyzes the ranked list of providers to identify the top option. Before dispatching, it verifies the provider's operational status. The agent then routes the request to the selected provider's API endpoint. This process can be repeated periodically or triggered by price change alerts to ensure continuous cost optimization.
- Category: Operations and infrastructure
- Effect: Changes data in your accounts
- MCP servers: AI API Radar MCP (https://koskamo.com/explore/ai-api-radar-mcp)
- Source: AI API Radar — Developer & Agent API (https://aiapi.dropwatchhq.com/docs)
- Source quote: "Programmatically route to the cheapest operational LLM, read exclusive per-model price history, check provider status, and subscribe to price-cut alerts"
- Playbook page: https://koskamo.com/explore/use-cases/route-llm-requests-to-cheapest-operational-model
Prompt: Find the cheapest operational LLM model that supports at least 128K context window. Check its current status. If it is operational, provide the provider name and the estimated cost per million tokens. Then, simulate routing a request to this provider.