CrawlEyes MCP Server
CrawlEyes is a web scraping and search toolkit for AI agents that provides full-text extraction, robust search via SearXNG, and semantic reranking. It ships as a standard MCP server, allowing any MCP client to reuse search and extraction capabilities. It features zero API-key fallback, China-friendly operation, and local semantic reranking without heavy dependencies.
Package and access
Local package with source-attributed installation metadata. Koskamo does not execute packages during review.
What you can do with it
- Extract full-text content from web pages with noise removal
- Perform robust web search using SearXNG with Tavily fallback
- Apply semantic reranking to search results locally
- Enable AI agents to see and read the web via MCP tools
Source and maintenance
- Maintenance checked
Packages and installation
Source-provided package data. Koskamo has not executed or live-probed this package.
crawleyes 0.2.0
{
"version": "0.2.0",
"transport": "stdio",
"identifier": "crawleyes",
"registryType": "pypi",
"environmentVariables": [
{
"name": "SEARXNG_URL",
"format": "string",
"description": "Optional. Base URL of a SearXNG instance (e.g. http://localhost:8080). If unset, falls back to Tavily keyless."
},
{
"name": "TAVILY_API_KEY",
"format": "string",
"description": "Optional. Tavily API key for higher-rate search fallback. If unset, uses Tavily keyless (rate-limited)."
}
]
}Tools
Reported by the attributed source; not independently observed by Koskamo.
Connect from your client
Each snippet configures the same source-provided package; replace placeholders before use.
Cursor
{
"mcpServers": {
"crawleyes-mcp-server": {
"command": "uvx",
"args": [
"crawleyes==0.2.0"
],
"env": {
"SEARXNG_URL": "<YOUR_SEARXNG_URL>",
"TAVILY_API_KEY": "<YOUR_TAVILY_API_KEY>"
}
}
}
}Cline
{
"mcpServers": {
"crawleyes-mcp-server": {
"command": "uvx",
"args": [
"crawleyes==0.2.0"
],
"env": {
"SEARXNG_URL": "<YOUR_SEARXNG_URL>",
"TAVILY_API_KEY": "<YOUR_TAVILY_API_KEY>"
}
}
}
}VS Code
{
"servers": {
"crawleyes-mcp-server": {
"type": "stdio",
"command": "uvx",
"args": [
"crawleyes==0.2.0"
],
"env": {
"SEARXNG_URL": "<YOUR_SEARXNG_URL>",
"TAVILY_API_KEY": "<YOUR_TAVILY_API_KEY>"
}
}
}
}Claude Desktop
{
"mcpServers": {
"crawleyes-mcp-server": {
"command": "uvx",
"args": [
"crawleyes==0.2.0"
],
"env": {
"SEARXNG_URL": "<YOUR_SEARXNG_URL>",
"TAVILY_API_KEY": "<YOUR_TAVILY_API_KEY>"
}
}
}
}Let your agent find its tools
Find servers like CrawlEyes MCP Server from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.