aiagents.org

jevcrawl

MCP server and command line crawler that returns only passages answering a goal.

  • AI tool
  • Free

Visit site

Pricing

Free and Apache-2.0 licensed, but it needs a Jev API key; per the README, billing covers input tokens only, about $0.042 per 1M tokens on version 1.13.0 of Jev.

Overview

jevcrawl is an MCP server and command-line tool that crawls a website toward a question you give it. A small decision model from TypeSafe, called Jev, scores each link and passage, so your agent's own LLM reads only the relevant text instead of whole pages. Every passage returned is lifted word for word from the page, along with its source address, the headings above it, and its character position. It needs a Jev API key and works with MCP clients such as Claude Code, Claude Desktop, and Cursor.

Key features

  • Three tools: crawl toward a goal, scrape one page, and map ranked URLs
  • Passages returned verbatim with source URL and offsets
  • Optional rendering for pages that need JavaScript
  • Spending cap per crawl
  • Works through MCP or the command line

Use cases

Alternatives

  • Agent4RecOpen-source recommender-system simulator populated by LLM-powered generative agents.ai agent
  • AvidnoteAI research workspace for writing papers, reading documents, and analyzing research data.AI toolFreemium
  • BlumifyTracks interviews and podcasts of AI leaders with summaries linked to transcripts.AI toolFreemium
  • ConsensusAcademic search engine that finds peer-reviewed papers and synthesizes evidence for research questions.AI toolFreemium
  • ExaWeb search and retrieval API for ai agents, with search, contents, and research endpoints.AI toolFreemium
  • Gemini Deep ResearchGoogle DeepMind research agent that plans web searches and produces cited reports through an API.AI tool

Last updated 2026-10-15