GenPark Bloom Filter URL Dedup Crawler MCP
An in-memory Bloom filter implementation for URL and document hash deduplication, designed to prevent redundant web crawler ingestion. It is built with 100% Python Standard Library dependencies, ensuring zero third-party runtime requirements. The server plugs directly into MCP-compatible environments like Claude Desktop, Cursor, and LobeChat, offering production resilience with strict schema conformance and enterprise-hardened performance for RAG ingestion and search pipelines.
Package and access
Local package with source-attributed installation metadata. Koskamo does not execute packages during review.
What you can do with it
- Deduplicate URLs during web crawling to avoid redundant ingestion
- Filter document hashes to prevent duplicate data processing
- Integrate with RAG ingestion pipelines for efficient data handling
- Deploy as an MCP server in autonomous agent workflows
Source and maintenance
- Maintenance checked
Packages and installation
Source-provided package data. Koskamo has not executed or live-probed this package.
https://github.com/Alpha-Park/genpark-bloom-filter-url-dedup-crawler-skill/releases/download/v1.0.1/genpark-bloom-filter-url-dedup-crawler-skill-v1.0.1.mcpb
{
"transport": "stdio",
"fileSha256": "41c5454d19b7b064a4af789c53a6c99ef0fbab52a01af3ec8c3ad1310e7f399c",
"identifier": "https://github.com/Alpha-Park/genpark-bloom-filter-url-dedup-crawler-skill/releases/download/v1.0.1/genpark-bloom-filter-url-dedup-crawler-skill-v1.0.1.mcpb",
"registryType": "mcpb"
}Tools
Reported by the attributed source; not independently observed by Koskamo.
Let your agent find its tools
Find servers like GenPark Bloom Filter URL Dedup Crawler MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.