Overview

CrawlForge MCP is an MCP server that gives Claude, Cursor and other MCP clients 31 tools for working with the live web. The tools fetch and scrape pages into clean Markdown or schema-checked JSON, crawl and map sites, search, track Google rankings and page changes, parse documents and drive browser sessions. It also has a research agent that plans its own searches from a plain-language request, and LLM extraction runs on a local Ollama model unless you choose a cloud model. Every call uses credits on a CrawlForge account. Its stealth browsing options can get around bot blocking, so check a site's terms before scraping it.

Key features

31 MCP tools for scraping, crawling, search and documents

Markdown and schema-checked JSON output

Autonomous research agent with step and URL limits

Extraction on a local Ollama model unless you pick a cloud one

Browser automation and change tracking

One-command setup for Cursor, Claude Code and Claude Desktop

Alternatives

Agent4RecOpen-source recommender-system simulator populated by LLM-powered generative agents.ai agent

AvidnoteAI research workspace for writing papers, reading documents, and analyzing research data.AI toolFreemium

BlumifyTracks interviews and podcasts of AI leaders with summaries linked to transcripts.AI toolFreemium

ConsensusAcademic search engine that finds peer-reviewed papers and synthesizes evidence for research questions.AI toolFreemium

ExaWeb search and retrieval API for ai agents, with search, contents, and research endpoints.AI toolFreemium

Gemini Deep ResearchGoogle DeepMind research agent that plans web searches and produces cited reports through an API.AI tool

CrawlForge MCP

Pricing

Overview

Key features

Use cases

Alternatives