Skip to content

Add Octocrawl MCP server - #218

Open
77777R7 wants to merge 1 commit into
cline:mainfrom
77777R7:add-octocrawl
Open

77777R7 wants to merge 1 commit into
cline:mainfrom
77777R7:add-octocrawl

Conversation

@77777R7

@77777R7 77777R7 commented Oct 11, 2026

Copy link
Copy Markdown

Adds Octocrawl to registry/mcps/octocrawl/ (entry.json and a 256×256 icon.png).

Octocrawl reads web pages for agents. scrape returns a page as Markdown, JSON, links or HTML, and map lists a site's URLs. Every answer carries an Evidence Record: the final URL, HTTP status, robots.txt decision and hashes of what was read. A blocked, empty or wrong page comes back as such, with the reason.

  • Install: cline mcp install octocrawl --transport http https://mcp.octocrawl.dev/mcp
    • This is the hosted service: no account or key, 20 pages a day per address.
    • The open-source server also runs locally with every tool. See install.notes.
  • Testing:
    • With Cline CLI 3.0.70, that install command reports installed.
    • An MCP client on the same URL lists scrape and map, and a scrape of https://example.com succeeds with HTTP 200.
  • Validation: npm run validate passes. verified is left false.
  • Source: https://github.com/77777R7/Octocrawl (AGPL-3.0-only). It is also in the official MCP Registry as io.github.77777R7/octocrawl.

🤖 Generated with Claude Code

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant