Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Commits on main
fix(deep-crawl): cap each BFS level to the remaining max_pages budget
7e76f20 drakeo338 committed 1 month ago
fix(deep-crawl): count queued next-level URLs against max_pages in BFS (#2338)
860072e drakeo338 committed 1 month ago
fix(docker): report a refused seed as a failed result, not a dead batch
350a141 ntohidi committed 1 month ago
Merge pull request #2289 from talelboussetta/bugfix/crawlresult-failed-shape
7e3518e Nasrin committed 1 month ago
Cloud: one line for the five services and the two paces in the README, the docs home and the docs banner
aadd82b unclecode committed 1 month ago
docs: credit Chunyi Liu and Julian Godfrey in SECURITY-CREDITS.md
9abbb47 ntohidi committed 1 month ago
fix(security): stop launching Chromium with certificate checks off
f0ada4c ntohidi committed 1 month ago
fix(security): escape crawled data in the LinkedIn graph view template
5fff5b9 ntohidi committed 1 month ago
fix(security): cap delay fields in untrusted CrawlerRunConfig bodies
d6fdff5 ntohidi committed 1 month ago
The cloud launch on main: the docs banner, the docs home, the daily notice, with the soft-launch words
8afd0a6 UncleCode committed 1 month ago
The cloud banner, the docs home, the daily notice and the README: free credit to start, no amount and no end date
4f105ff unclecode committed 1 month ago
README and the launch banner: free credit to start, no amount and no end date
df442c9 unclecode committed 1 month ago
fix(security): refuse caller-supplied regexes from untrusted bodies
8aea200 ntohidi committed 1 month ago
fix(security): refuse CosineStrategy.model_name from untrusted bodies
9bfe9c5 ntohidi committed 1 month ago
fix(security): stop css_selector and wait_for running page JavaScript from untrusted bodies
736a28a ntohidi committed 1 month ago
fix(security): route the cache freshness check through the egress proxy
4acca11 ntohidi committed 1 month ago
fix(deep-crawl): reset page budget on a fresh run of a reused strategy (#2309)
c24d12d Aryan Rane committed 1 month ago
docs(models): show the new CrawlResult defaults in the SDK reference
e88c441 Talel Boussetta committed 1 month ago
docs(models): show the new CrawlResult defaults; tighten the isolation test
1148176 Talel Boussetta committed 1 month ago
fix(models): default CrawlResult links and media to the scraped shape
8bd0776 Talel Boussetta committed 1 month ago
README: two ways to use Crawl4AI, the library and the cloud, with the launch banner
e5d2e78 unclecode committed 1 month ago
Crawl4AI Cloud is live: the README with the two ways to use it and the launch banner, the docs home, the cloud notice as a daily yellow banner while the offer runs
1f68e5b unclecode committed 1 month ago
Merge remote-tracking branch 'origin/develop' into cloud-launch
e2006d5 unclecode committed 1 month ago
cloud notice, README block, docs banner: the launch offer, your first $10 pack on us until 31 Dec 2026, then $5 to start
bcc7b43 unclecode committed 1 month ago