commoncrawl-mcp
An MCP server that allows agents to discover historical web captures via the Common Crawl index. It provides tools to list recent crawl collections, identify the newest collection, and search for URL or wildcard patterns to retrieve capture metadata like timestamps and digests. It searches the index only and does not download page contents.
Package and access
Local package with source-attributed installation metadata. Koskamo does not execute packages during review.
What you can do with it
- List recent crawl collections
- Search for URL capture metadata
- Provenance research
- Archival discovery
Source and maintenance
- Maintenance checked
Packages and installation
Source-provided package data. Koskamo has not executed or live-probed this package.
commoncrawl-mcp 1.0.1
{
"version": "1.0.1",
"transport": "stdio",
"identifier": "commoncrawl-mcp",
"registryType": "npm"
}Tools
Reported by the attributed source; not independently observed by Koskamo.
Connect from your client
Each snippet configures the same source-provided package; replace placeholders before use.
Cursor
{
"mcpServers": {
"commoncrawl-mcp-mcp": {
"command": "npx",
"args": [
"-y",
"commoncrawl-mcp@1.0.1"
]
}
}
}Cline
{
"mcpServers": {
"commoncrawl-mcp-mcp": {
"command": "npx",
"args": [
"-y",
"commoncrawl-mcp@1.0.1"
]
}
}
}VS Code
{
"servers": {
"commoncrawl-mcp-mcp": {
"type": "stdio",
"command": "npx",
"args": [
"-y",
"commoncrawl-mcp@1.0.1"
]
}
}
}Claude Desktop
{
"mcpServers": {
"commoncrawl-mcp-mcp": {
"command": "npx",
"args": [
"-y",
"commoncrawl-mcp@1.0.1"
]
}
}
}Let your agent find its tools
Find servers like commoncrawl-mcp from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.