WebCrawlerAPI MCP

A remote MCP server operated by WebCrawlerAPI that allows AI assistants to fetch and convert any public web page into clean Markdown. It supports JavaScript-rendered pages, removes boilerplate and ads, and uses OAuth 2.1 for authentication tied to the user's organization.

Visit WebCrawlerAPI

Endpoint and access

OAuth sign-in: the first time you connect, your client opens the vendor's own authorization prompt in a browser.

Vendor evidenceStreamable HTTPOAuth sign-inEndpoint checked 2026-11-01Operated by WebCrawlerAPI

You need:Requests are billed to that organization

MCP endpoint (Streamable HTTP)

https://mcp.webcrawlerapi.com/mcp

Vendor documentation

What you can do with it

Fetch a public web page and return its main content as Markdown
Convert JavaScript-rendered pages to clean Markdown
Remove navigation, ads, and boilerplate from web content

Source and maintenance

Vendor evidenceRegistry 0.1.3

mcp-registry: com.webcrawlerapi/mcp-server@0.1.3 Source repository Project website

Maintenance checked: Nov 1, 2026, 4:45 PM UTC

Tools

Reported by the attributed source; not independently observed by Koskamo.

No tool definitions available.

30-day availability

Aggregated from read-only remote checks; this is not a tool-execution or security guarantee.

Successful checks: 1 of 1 (100%)
Average latency: 616 ms
95th percentile latency: 616 ms

Maintenance history

Public check and source-refresh events. Editorial and ownership records remain private.

Nov 1, 2026, 4:50 PM UTC · probe · passed · 616 ms · metadata changed · refuses unauthenticated initialize (HTTP 401)

Connect from your client

Each snippet registers the same endpoint; pick the client you use.

This server is operated by the named third party. Listing and endpoint checks are not an endorsement or a security audit. Review the operator's permissions, terms, and data handling before connecting. How listings are checked and corrected.

Claude Code

Run this once in a terminal. It registers the remote server. Use --scope project to write .mcp.json for the repo.

Claude Code configuration

claude mcp add --transport http webcrawlerapi-mcp https://mcp.webcrawlerapi.com/mcp

Codex

Run this once. Codex stores MCP servers in ~/.codex/config.toml (or .codex/config.toml in a trusted project).

Codex configuration

codex mcp add webcrawlerapi-mcp --url https://mcp.webcrawlerapi.com/mcp

Cursor

Merge this server into .cursor/mcp.json in your project, then enable webcrawlerapi-mcp in your MCP settings.

Cursor configuration

{
  "mcpServers": {
    "webcrawlerapi-mcp": {
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

Cline

Merge this into cline_mcp_settings.json (Cline → MCP Servers → Configure).

Cline configuration

{
  "mcpServers": {
    "webcrawlerapi-mcp": {
      "type": "streamableHttp",
      "url": "https://mcp.webcrawlerapi.com/mcp",
      "disabled": false
    }
  }
}

VS Code

Merge this server into .vscode/mcp.json. Use MCP: List Servers to start webcrawlerapi-mcp and inspect its tools.

VS Code configuration

{
  "servers": {
    "webcrawlerapi-mcp": {
      "type": "http",
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

Gemini CLI

Run this once. It writes .gemini/settings.json in the current project; pass --scope user for ~/.gemini/settings.json.

Gemini CLI configuration

gemini mcp add --transport http webcrawlerapi-mcp https://mcp.webcrawlerapi.com/mcp

Claude Desktop

Merge this into claude_desktop_config.json (macOS: ~/Library/Application Support/Claude/, Windows: %APPDATA%\Claude\), then restart Claude Desktop.

Claude Desktop configuration

{
  "mcpServers": {
    "webcrawlerapi-mcp": {
      "url": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

Windsurf

Merge this into ~/.codeium/windsurf/mcp_config.json, then refresh MCP in Cascade. Windsurf remote servers use serverUrl, not url.

Windsurf configuration

{
  "mcpServers": {
    "webcrawlerapi-mcp": {
      "serverUrl": "https://mcp.webcrawlerapi.com/mcp"
    }
  }
}

Let your agent find its tools

Find servers like WebCrawlerAPI MCP from your agent. Add Koskamo once to search the index for endpoints, access requirements, and client setup. Public discovery needs no key.

Connect Koskamo Explore workflows

See all 7,372

Do you run WebCrawlerAPI MCP?

Prove ownership with a DNS record, a well-known file, or your Official MCP Registry entry, and your edits publish immediately. Proofs are re-checked weekly; admins can still hide or remove a listing.

Claim this listing