Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Commits on main
fix(browser): clean up leaked Playwright driver when launch fails in __aenter__
701b0b1 Soham Kukreti committed 3 months ago
fix: remove_overlay_elements can remove body if it has a global popup class.
a574fbc Krzysztof Olipra committed 3 months ago
Merge pull request #2158 from unclecode/test/per-url-pdf-ssrf-regression
8319275 Nasrin committed 3 months ago
Merge pull request #2159 from unclecode/fix/pdf-redirect-cookie-session
133eff7 Nasrin committed 3 months ago
test(docker): cover the per-URL crawler_configs PDF SSRF guard
d57a31c ntohidi committed 3 months ago
Merge pull request #2150 from unclecode/fix/docker-pdf-crawler-pairing
37ee60a Nasrin committed 3 months ago
Merge pull request #2157 from unclecode/fix/monitor-dashboard-redirect
5b2e86f Nasrin committed 3 months ago
fix(docker): redirect /monitor to the dashboard UI (issue #2091, point 7)
ffd9a36 ntohidi committed 3 months ago
Merge pull request #2156 from unclecode/fix/compose-comment-indent
7941355 Nasrin committed 3 months ago
fix(docker): align commented env var lines with the environment list
fe4d4b4 ntohidi committed 3 months ago
Merge pull request #2094 from unclecode/fix/docker-deploy-0.9-gaps
1c4ac64 Nasrin committed 3 months ago
Merge pull request #2142 from unclecode/fix/egress-proxy-upstream-chaining
59ac8f4 Nasrin committed 3 months ago
fix(docker): forward CRAWL4AI_API_TOKEN through compose, make .llm.env optional
e07ac4f Soham Kukreti committed 3 months ago
fix(docker): declare output_path as deprecated no-op, harden legacy-compat tests
a01442d Soham Kukreti committed 3 months ago
fix(docker): distinguish removed hooks.code in the disabled-hooks 403
cd78a44 Soham Kukreti committed 3 months ago
fix(docker): compose v5 compatibility, legacy-field warnings, playground error handling
8748b81 Soham Kukreti committed 4 months ago
fix(docker): fall through junk proxy env values, refuse non-http proxy schemes
01e6e96 Soham Kukreti committed 3 months ago
fix(docker): close SSRF gap on per-URL configs and dispose PDF crawlers (#2127)
2341507 Soham Kukreti committed 3 months ago
fix(docker): validate PDF download redirects against SSRF (#2127)
4138ada Soham Kukreti committed 3 months ago
fix(docker): route PDFContentScrapingStrategy requests to PDFCrawlerStrategy (#2127)
4ccd143 Soham Kukreti committed 3 months ago
Merge pull request #2093 from unclecode/docs-self-hosting-update
fc6ec13 Nasrin committed 3 months ago
Merge pull request #2148 from weike-zhang/fix/mcp2-docker-requirements
3271ad2 Nasrin committed 3 months ago
fix(docker): cap mcp below 2 to keep the v1 low-level API used by mcp_bridge
95f2952 Weike Zhang committed 3 months ago
fix(crawler): make the visibility warning survive verbose=False
1bac351 ntohidi committed 3 months ago