Botcard MCP
An official MCP server providing read-only tools to check robots.txt compliance for AI crawlers, list known crawler tokens, and suggest robots.txt configurations based on policy preferences.
Endpoint and access
No sign-in to connect and list tools. Individual tools may still need a vendor account, credentials, or permissions; check the documented prerequisites.
https://whosthatbot.com/mcpWhat you can do with it
- Check if a specific user-agent is allowed or disallowed in a robots.txt file
- List available AI crawler tokens and their vendor stances
- Suggest robots.txt rules based on allow/block policies
Source and maintenance
Tools
Reported by the attributed source; not independently observed by Koskamo.
Maintenance history
Public check and source-refresh events. Editorial and ownership records remain private.
- · registry · passed · metadata changed · Source metadata updated
- · backfill · recorded · Pre-expansion baseline; unobserved rich metadata remains unknown
Connect from your client
Each snippet registers the same endpoint; pick the client you use.
Claude Code
claude mcp add --transport http botcard-mcp https://whosthatbot.com/mcpCodex
codex mcp add botcard-mcp --url https://whosthatbot.com/mcpCursor
{
"mcpServers": {
"botcard-mcp": {
"url": "https://whosthatbot.com/mcp"
}
}
}Cline
{
"mcpServers": {
"botcard-mcp": {
"type": "streamableHttp",
"url": "https://whosthatbot.com/mcp",
"disabled": false
}
}
}VS Code
{
"servers": {
"botcard-mcp": {
"type": "http",
"url": "https://whosthatbot.com/mcp"
}
}
}Gemini CLI
gemini mcp add --transport http botcard-mcp https://whosthatbot.com/mcpClaude Desktop
{
"mcpServers": {
"botcard-mcp": {
"url": "https://whosthatbot.com/mcp"
}
}
}Windsurf
{
"mcpServers": {
"botcard-mcp": {
"serverUrl": "https://whosthatbot.com/mcp"
}
}
}Let your agent find its tools
Find servers like Botcard MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.
Other developer tools servers
Do you run Botcard MCP?
Prove ownership with a DNS record, a well-known file, or your Official MCP Registry entry, and your edits publish immediately. Proofs are re-checked weekly; admins can still hide or remove a listing.