MIDREAL
Menu

Home / crawl4ai

unclecode

crawl4ai

WatchingWatchingNone of the above. Nothing stands out yet. More on the methodology page

unclecode/crawl4ai

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

PythonCategories: MCPSelf-hosted

Social preview image for crawl4ai

Our summary

Crawl4AI is an open-source web crawler and scraper that turns web pages into Markdown for LLMs and AI agents. It can be run as a Python library, a Docker server, or used through a hosted cloud API.

Who it is for: Developers building LLM, RAG, AI agent, or data pipeline applications

What the README claims

  • Produces clean, LLM-ready Markdown from web pages turns any website into clean, LLM-ready Markdown for RAG, AI agents and data pipelines Too broad to verify
  • Free tier includes 1,000 credits every month for the cloud service Free: 1,000 credits every month, 10 a minute, 2 at a time Not checked
  • Discovers URLs with prefetch mode that the README says is faster `prefetch=True` finds URLs 5 to 10 times faster Not checked
  • Can crawl up to 10,000 URLs in a background job via the cloud up to 50 URLs in one streamed call, or 10,000 in a background job Not checked
  • Supports Chromium, Firefox and WebKit browsers **Chromium, Firefox and WebKit** Not checked

Written by AI from the project's README on 2026-10-30. It does not affect the verdict.

Watching: no other rule matched yet.

7-day star gain 270, down from 302 the week before.

Commits in the last 30 days: 108, up from 88 30 days earlier.

Gaining 270 stars this week, 0.7x its usual pace. Last push 2 days ago.

Verdict

REAL scored 1h ago

Hype
81
Reality
84
Hype Gap
-3
Momentum
0.7x
Confidence
85%
  • Adopted moves Reality +13 points.
  • Responsive moves Reality +7 points.
  • Maintained moves Reality +3 points.

Rule verdict-2.0, scoring score-2.0. How we score. Backtest.

Repository on GitHub Project homepage

Find them on

Maintained by

Maintained by 1 primary developer, 10 external contributors in the last 90 days.

  • unclecode is a GitHub individual account.
  • GitHub account created May 2015.
  • Top contributors by commits: unclecode 58%, ntohidi 22%, aravindkarnam 5%.

Why now 0% of its stars arrived in the last 7 days. Gaining 0.7x its usual weekly pace. No Hacker News posts in the last 7 days.

Stars StarsThe number of GitHub stars on the repository at our latest reading.
87,646
Gain 7d Gain 7dStars gained since our latest reading from at least 7 days ago.
+270
Pace Velocity (Nx usual pace)This week's star gain divided by the project's usual weekly gain. The usual gain is the average weekly gain over the 4 weeks before (days 8 to 35 ago), counted as at least 10 stars. 2.0x means twice the usual pace. Without a reading from 35 days ago, the ranking assumes 2% of the stars the project had 7 days ago as its usual weekly gain. More on the methodology page
0.7x usual 409 a week
HN points HN pointsHacker News points added up across posts that mention the project, published in the last 7 days.
0 7 days
Downloads DownloadsDownloads per day of the project's package, as the registry (npm or PyPI) reports them.
n/a
Contributors Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.
114
Last release Latest releaseDays since the latest GitHub release was published.
2 days ago

Gain 24h Gain 24hStars gained since our latest reading from at least 24 hours ago. +28. Forks ForksThe number of GitHub forks of the repository at our latest reading. 9,139. Open issues Open issuesThe number of open issues on the repository at our latest reading, as GitHub counts them. 343. Days since push Days since pushDays since the last push to the repository. 2 days. Archived ArchivedWhether the owner has archived the repository on GitHub. An archived repository is read-only. no. Hacker News posts in 7 days Hacker News postsThe number of Hacker News posts that mention the project, published in the last 7 days.: 0. Watchers WatchersThe number of GitHub users watching the repository for notifications, at our latest reading. 422.

Facts

License
Apache-2.0 source, checked 22 Nov 2026
Language
Python source, checked 22 Nov 2026
Homepage
https://crawl4ai.com/?ref=github-about source, checked 22 Nov 2026
Last release
v0.9.6, 20 Nov 2026 source, checked 22 Nov 2026
Releases
24 source, checked 20 Nov 2026
Contributors
114 source, checked 20 Nov 2026
Archived
no source, checked 22 Nov 2026

Nerd stuff

PythonDockerSelf-hostedCLI

Languages
Python (detected), JavaScript (detected), Shell (detected), Dockerfile (detected)
Runs on
Python >=3.10 (detected)
Interfaces
CLI (detected)
Deployment
Docker Compose (detected), Docker (detected)
Hardware
CUDA: referenced (detected)
Paid APIs
Anthropic: referenced (detected), Gemini: referenced (detected), Groq: referenced (detected), Mistral: referenced (detected), OpenAI: referenced (detected)
Docs
docs/ folder (detected)
License
Apache-2.0 (detected)
Package ecosystem
Python packaging (detected)

The Receipts

SourceEvidenceDate
Hacker NewsThread, 1 points, 0 comments10 Jul 2026
Hacker NewsThread, 3 points, 0 comments23 Jan 2026
Hacker NewsThread, 1 points, 0 comments18 Nov 2025
Newsletter or feedTurning a docs site into clean Markdown for RAG for about 10 cents per 1,000 pages13 Nov 2026
Newsletter or feedHow to give Claude Code a web scraping tool with Crawl4AI (MCP)25 Oct 2026
Newsletter or feedFirecrawl Alternatives Priced on One Real Job: 20,000 Pages a Month14 Oct 2026
PackagePyPI Crawl4AInot recorded
deps.devDependent packages on PyPI: 15320 Nov 2026
deps.devSecurity advisories on PyPI: 022 Nov 2026

What changed recently

GitHub release dates we stored. We do not track license changes yet.

Cite this

crawl4ai is a GitHub project at https://github.com/unclecode/crawl4ai written mainly in Python, described there as "Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it".

Source: https://midorreal.com/project/unclecode-crawl4ai, checked 22 November 2026. The same facts as JSON: /project/unclecode-crawl4ai.json.

Rank history

Peak day: +598 stars on 13 Sep 2026, 70 days ago.

Stars

Stars each day Stars each dayThe highest star count we recorded on each day., last 78 days. Without JavaScript this shows the last 30 days.

Events in this window

Dated items we stored, last 30 days. They sit near the chart, they do not explain it.

Stars gained each day Stars gained each dayThe difference in the daily peak star count between consecutive days that both have a reading., between readings on consecutive days. Last 30 days in the fallback.

Packages

RegistryPackage
PyPICrawl4AI

Only packages whose registry page links back to this repository are listed.

Signals

SourceWhat we measuredChecked
GitHub87,646 stars, 270 gained in 7 days22 Nov 2026
Hacker News3 posts stored, 0 points in the last 7 days7 Oct 2026
Feed mentions3 mentions in tracked newsletters and blogs13 Nov 2026
npmNo linked package found-
PyPINo linked package found-
Docker HubNo linked package found-
crates.ioNo linked package found-
HomebrewNo linked package found-
deps.dev153 PyPI dependents20 Nov 2026
Hugging FaceNot tracked yet-
BlueskyNot tracked yet-
Stack ExchangeNot tracked yet-
YouTubeNot tracked yet-

Attention vs adoption

Attention: above 56% of tracked projects 56%
Star velocity against all tracked projects

Adoption: above 93% of tracked projects 93%
Strongest of downloads, dependents and pulls (deps.dev)

Adoption runs ahead of attention: star velocity above 56% of tracked projects, best adoption figure above 93%. This describes the numbers; it is not a verdict.

Compared with MCP

MeasureThis projectCategory median
Star velocity0.70.4
Days since release1.63.7
Contributors, all time1142
Median time to first reply on issues5 days13 hours
Commits in the last 30 days10853

Star velocity: above 59% of MCP projects

Days since release: above 23% of MCP projects

Contributors, all time: above 90% of MCP projects

Median time to first reply on issues: above 75% of MCP projects

Commits in the last 30 days: above 68% of MCP projects

Compared with the project's first category only. A percentile line appears only where at least 30 projects in the category have the measure. This describes the numbers; it is not a verdict.

Compare with

Hacker News

Points by day Hacker News points by dayPoints on Hacker News posts that mention the project, grouped by the day each post was published. across 3 posts and 3 days, 5 points in total.
PostPoints PointsThe points the post has on Hacker News.Comments CommentsThe number of comments on the post on Hacker News.Date
Hacker News post 1 0 10 Jul 2026
Hacker News post 3 0 23 Jan 2026
Hacker News post 1 0 18 Nov 2025

Repo health

  • Languages LanguagesShare of the repository's code by bytes, as GitHub's language detection reports it. The five biggest languages are named and the rest are grouped as Other.Python 99%, JavaScript 1%
  • License LicenseThe SPDX license id GitHub detects, and a class: Open source (OSI) if the license is on the Open Source Initiative approved list, Source-available if the code is readable but the license limits use, Unclear if GitHub cannot match a known license, No license detected if it finds none. A public repository without a license is not open source.Apache-2.0, Open source (OSI)
  • Repository age Repository ageTime since the repository was created on GitHub. This is the repository, not necessarily the project, which may have existed elsewhere before.2 years, created 9 May 2024
  • Release dates Release datesThe date of the first and the latest GitHub release, and the latest release tag. Projects that ship without GitHub releases show none.First release 4 Mar 2025, current version v0.9.6 (20 Nov 2026)

Development

  • Commits in the last 7 days Commits in the last 7 daysCommits to the repository in the last 7 days, as GitHub counts them.45
  • Commits in the last 30 days Commits in the last 30 daysCommits to the repository in the last 30 days, as GitHub counts them.108
  • Commits in the last 90 days Commits in the last 90 daysCommits to the repository in the last 90 days, as GitHub counts them.263
  • Contributors, all time Contributors, all timePeople and anonymous contributors who have ever committed to the repository, as GitHub counts them. A small number is context, not a flaw: many solid projects are kept by one or two people.114
  • Releases ReleasesThe number of GitHub releases, and how many days ago the latest one was published.24, latest release 2 days ago
  • Releases in the last 90 days Releases in the last 90 daysHow many GitHub releases were published in the last 90 days.4
  • Issues in the last 30 days Issues in the last 30 daysIssues opened and issues closed in the last 30 days, as GitHub search counts them.35 opened, 27 closed
  • Pull requests merged in the last 30 days Pull requests merged in the last 30 daysPull requests merged in the last 30 days, as GitHub search counts them.41
  • Packages that depend on the latest version Packages that depend on the latest versionHow many other packages list the project's latest published version as a dependency, from deps.dev, added up across npm and PyPI.153

Maintenance

  • Median time to first reply on issues Median time to first reply on issuesMedian time between an issue being opened and the first comment from someone other than its author, over a sample of the last 30 closed issues. Issues with no reply are left out of the median and counted separately.5 days
  • Median time to close issues Median time to close issuesMedian time from opening to closing, over a sample of the last 30 closed issues.17 days
  • Sampled issues with no reply Sampled issues with no replyHow many of the sampled closed issues never got a comment from someone other than their author.1 of 25
  • Stale open issues Stale open issuesOpen issues with no update in the last 90 days, as GitHub search counts them.19
  • Open pull requests Open pull requestsPull requests open now, as GitHub search counts them.292

Hygiene

  • Automated tests or builds (CI) Automated tests or builds (CI)Whether the repository has at least one GitHub Actions workflow file in .github/workflows.Yes
  • A tests folder A tests folderWhether the repository has a top-level folder named tests, test, __tests__ or spec.Yes
  • A license A licenseWhether GitHub detects a license file in the repository.Yes
  • Contributing guide Contributing guideWhether the repository has a contributing guide.Yes
  • Code of conduct Code of conductWhether GitHub finds a code of conduct in the repository.Yes
  • CODEOWNERS file CODEOWNERS fileWhether the repository has a CODEOWNERS file, which names who reviews changes to which files.No
  • A Dockerfile A DockerfileWhether the repository has a Dockerfile at its top level.Yes

Security

  • Security policy Security policyWhether the repository has a SECURITY.md or SECURITY.rst file.Yes
  • Unpatched high or critical advisories Unpatched high or critical advisoriesPublished GitHub security advisories rated high or critical on this repository that list a vulnerable version with no patched version.0
  • Signed latest release Signed latest releaseWhether the latest GitHub release has an attached signature file (.sig, .asc or .sigstore).No
  • Known advisories on the latest version Known advisories on the latest versionSecurity advisories deps.dev lists against the project's latest published version, added up across npm and PyPI.0

Badge

For maintainers: one measured fact, no verdict. First spotted by Mid or Real at 84,848 stars on 6 Oct 2026

Markdown

[![Mid or Real](https://midorreal.com/badge/unclecode-crawl4ai.svg)](https://midorreal.com/project/unclecode-crawl4ai)

HTML

<a href="https://midorreal.com/project/unclecode-crawl4ai"><img src="https://midorreal.com/badge/unclecode-crawl4ai.svg" alt="Mid or Real"></a>

Verdict badge: Mid or Real: REAL It shows the verdict as this page shows it today.

Markdown

[![Mid or Real: REAL](https://midorreal.com/badge/unclecode-crawl4ai.svg?style=verdict)](https://midorreal.com/project/unclecode-crawl4ai)

HTML

<a href="https://midorreal.com/project/unclecode-crawl4ai"><img src="https://midorreal.com/badge/unclecode-crawl4ai.svg?style=verdict" alt="Mid or Real: REAL"></a>

Passport

Copy these facts into a post, a README or a page. Cite as "Source: Mid or Real". Full record: JSON.




First tracked 6 Oct 2026 at 84,848 stars.

Projects blowing up

How we call a verdict

Is this your project? Claim it

Figures by method 1.0