Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Commits on main
fix(playground): replace the Python config editor with a JSON params editor
9340d09 ntohidi committed 2 months ago
fix(tables): expand rowspan/colspan into a grid and keep <th> row headers
dd542e7 ntohidi committed 2 months ago
Merge pull request #2237 from unclecode/fix/permanent-browser-egress-signature
c69d625 Nasrin committed 2 months ago
the cloud notice: a README block, and a short notice at crawl4ai-setup and once per machine at first run
b7ea000 unclecode committed 2 months ago
docs banner: the public name api.crawl4ai.com in the lines people copy
0d777bb unclecode committed 2 months ago
Merge pull request #2241 from Zsanz3/cursor/fix-optimization-hints-segv-fba7
75bacbd Nasrin committed 2 months ago
fix(security): stop {"type":"dict","value":X} laundering typed objects past the untrusted gate
ce62ae6 ntohidi committed 2 months ago
fix(browser): drop OptimizationHints from --disable-features
5ee5110 Cursor Agent committed 2 months ago
fix(docker): build permanent browser with egress-hardened default config so its pool signature matches
7b02a2c Soham Kukreti committed 2 months ago
fix(docker): apply the recycle policy in the pool, not in config.yml kwargs
47ea8d7 ntohidi committed 2 months ago
fix(docker): recycle pooled browser contexts by pages served (#2231)
6ccf610 ntohidi committed 2 months ago
fix(security): route the seeder and robots.txt fetches through the egress proxy
07873f1 ntohidi committed 2 months ago
fix: preventing disallow: /*? from blocking the whole website.
f56c69e Krzysztof Olipra committed 2 months ago
fix(docker): skip /config/dump pre-flight for md/llm endpoints in playground
07c70d8 Soham Kukreti committed 2 months ago
docs: credit Zhixi (Jace) Sun by GitHub handle in security credits and release notes
5ee246f ntohidi committed 2 months ago
docs: add the non-security bug fixes to the v0.9.3 release notes
7245f98 ntohidi committed 2 months ago
docs: release notes, changelog, README, and security credits for v0.9.3
4bcd5fa ntohidi committed 2 months ago
fix(playground): remove innerHTML round-trip to prevent DOM-based XSS
0213355 ntohidi committed 3 months ago
fix(pdf): escape paragraph text in cleaned_html to prevent XSS
ceaf6a3 ntohidi committed 3 months ago
fix(pdf): validate egress destinations and bound resource use in PDF fetch
4772236 ntohidi committed 3 months ago
fix(security): block PDF image-write fields from untrusted config bodies
3273f75 ntohidi committed 2 months ago
Merge pull request #2160 from unclecode/fix/browser-startup-driver-leak
023c87d Nasrin committed 2 months ago