Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Commits on main
docs: release notes, changelog, README, and security credits for v0.9.4
133e1d9 ntohidi committed 1 month ago
Merge branch 'develop' of https://github.com/unclecode/crawl4ai into develop
303a9cc ntohidi committed 1 month ago
Merge pull request #2280 from unclecode/docs-security-md-known-issues
e668bb7 Nasrin committed 1 month ago
docs(security): list fixed issues and features per release through v0.9.3
06c8acf Soham Kukreti committed 1 month ago
cloud notice: the monthly offer, once per release, and the two moments of pain
5face68 unclecode committed 1 month ago
Merge pull request #2279 from unclecode/chore/2255-remove-dead-google-script
2d1b745 Nasrin committed 1 month ago
Merge pull request #2232 from unclecode/fix/issue-2231-pooled-context-recycle
a18b08f Nasrin committed 1 month ago
Merge pull request #2269 from nightcityblade/docs-security-supported-versions-v2
673171a Nasrin committed 1 month ago
Merge pull request #2265 from unclecode/fix/2242-deep-crawl-perf
2740268 Nasrin committed 2 months ago
fix(deep-crawl): keep the shallowest depth when de-duplicating best-first links
e5e1011 ntohidi committed 2 months ago
Merge pull request #2266 from unclecode/fix/timeout-ceiling-followup
06cb0a8 Nasrin committed 2 months ago
Merge pull request #2212 from damusix/fix/configurable-max-timeout
8ccfbcd Nasrin committed 2 months ago
fix(deep-crawl): drop the O(n^2) parent scan and the duplicate best-first enqueue
19f3e5e ntohidi committed 2 months ago
Merge pull request #2263 from unclecode/fix/2255-discord-stargazer-workflow
d2fb4ac Nasrin committed 2 months ago
fix(ci): don't let the stargazer tracking step block Discord notifications
519d85f ntohidi committed 2 months ago
Merge pull request #2261 from unclecode/fix/2258-table-grid-rowspan
145630d Nasrin committed 2 months ago
fix(tables): clamp colspan and rowspan so one cell cannot hang the parse
ee1a295 ntohidi committed 2 months ago
Merge pull request #2262 from unclecode/fix/2260-playground-params-editor
ab5271f Nasrin committed 2 months ago
fix(playground): forward the typed params, and clear status when config is empty
e138aa0 ntohidi committed 2 months ago