crawl4ai
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
At a glance
Is this tool relevant to you?
What it does
Open-source web crawler and scraper for LLMs and AI agents: any website into clean, LLM-ready Markdown. Run it yourself, or use Crawl4AI Cloud with one key.
May suit
People who want an AI system to plan or carry out multi-step tasks.
Before you try it
The repository reports a Apache-2.0 license. Setup difficulty and device support still need to be checked upstream.
Evidence & freshness
What we know, and how recently we checked
Core repository facts were fetched from GitHub and passed the catalog quality checks at the displayed source timestamp.
- Source
- Verified GitHub snapshot
- Checked
- Snapshot evidence level
- High confidence
- Maintenance signal
- Healthy66/100
Generally healthy automated signals, with some areas worth checking in the breakdown.
The health score is an automated maintenance signal, not a security audit or a guarantee that the tool fits your needs.
How verification and health scoring work
Catalog-verified records use a timestamped GitHub snapshot that passed source and completeness checks. Basic listings come from the wider automated sync and have not yet passed that stronger verification path.
Health combines recent activity, commit frequency, issue handling, contributor depth, release cadence, documentation, and community signals. Missing evidence lowers how much confidence you should place in the number.
Read the full methodology →⭐
84.7K
Stars
🍴
8.8K
Forks
👥
95
Contributors
💚
Healthy66/100
Health Score
Star History
Not enough data for chart
Health Score Breakdown
Star Momentum
0
Commit Frequency
53
Issue Health
80
Contributors
100
Release Cadence
80
Documentation
100
Community Signal
100
Project Info
- Language
- Python
- License
- Apache-2.0
- Last Commit
- 2026-09-25 06:37 UTC
- Last Release
- v0.9.4 (2026-09-23 12:14 UTC)
- Open Issues
- 226
- Bus Factor
- 9
- Commits/Week
- 10.6
- Avg Issue Close
- 6.2 days
aiai-agentscrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Project Badge
Embed a live health badge in a README or docs page.
[](https://ai-tools-scout.com/projects/crawl4ai)Related tools to compare with crawl4ai
Suggested automatically from the same category and shared topics, then ordered by current maintenance and adoption signals.
crawl4ai vs firecrawlStrong80/100
188.4K stars+36.0K weekly
Verified snapshot
crawl4ai vs langchainStrong84/100
147.4K stars+599 weekly
Verified snapshot
crawl4ai vs Deer FlowStrong90/100
77.6K stars+10.7K weekly
Basic listing
crawl4ai vs browser-useStrong84/100
117.1K stars+12.7K weekly
Verified snapshot
crawl4ai vs hermes-agentStrong95/100
251.1K stars+74.1K weekly
Verified snapshot
Weekly AI open-source movers
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.