Repo RadarNewsletter

Trending/MCP servers

MCP serversLLM & modelsAgents & orchestration

unclecode/crawl4ai

Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.…

★ 86.6KWeek rank 142 · star gain starts at the next snapshot

View on GitHub

From the README

🚀🤖 Crawl4AI: the open-source web crawler for LLMs and AI agents **Latest: v0.9.5 (14 Oct 2026)** · all releases → Crawl4AI turns any website into clean, LLM-ready Markdown for RAG, AI agents and data pipelines.

Setup prompt

Paste this into Cursor or Claude Code. It only includes install lines found in the README, and it asks the agent to review the code first.

Set up the GitHub repository unclecode/crawl4ai (Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key. Join our Discord https://discord.gg/VuxzM8mtf).
Repository: https://github.com/unclecode/crawl4ai

Official install commands found in the README:
pip install -U crawl4ai
Docker server, CLI and every option: [Installation](#installation) · [docs.crawl4ai.com](https://docs.crawl4ai.com)

Clone the repository and follow those steps. Do not invent package names or extra install commands.
Review the code before running anything.

Buzz by window

Same mentions, three half-lives. This is not a star history. Star gain appears after a second daily snapshot.

  • Today0.07
  • Week0.89
  • Month1.28

Spotted on

Related

Report a problem or request removal