Skip to content

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

Commits on main

fix(docker): authenticate rate limit redis storage
Harsh Mathur committed 4 months ago
979e8e6
chore: remove dead normalize_url definitions from utils
Rajan Chavada committed 4 months ago
44968c5
chore: remove accidental copy of adaptive_crawler
Rajan Chavada committed 4 months ago
6a181da
fix(docker): make read-only tmpfs writable
nightcityblade committed 5 months ago
c8aee8c
fix(docker): cap FastAPI below 0.137
nightcityblade committed 5 months ago
9018f60
fix: stabilize best-first batch ordering
nightcityblade committed 5 months ago
39f730a
fix: close browser contexts from snapshot
nightcityblade committed 5 months ago
777a250
cdf2ead
security: non-breaking hardening patch (0.8.8)
unclecode committed 5 months ago
aa81e8f
chore: gitignore out/ local pipeline output
unclecode committed 5 months ago
72fd78e
chore: bump version to 0.8.7
unclecode committed 5 months ago
4bf6071
c06a3dc