Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
Commits on main
fix(prefetch): honor <head><base href> in quick_extract_links (#752)
62c619d unclecode committed 5 months ago
fix(async_webcrawler): skip block validator when downloaded_files is set
7059170 unclecode committed 6 months ago
feat: Add DomainMapper for comprehensive domain URL discovery
9d5bcf7 unclecode committed 8 months ago
merge: slot April 2026 security batch (Docker API vulns, SSRF, JWT, file-write, XSS, execute_js) into develop for 0.8.7
fcaf08b unclecode committed 5 months ago
Merge pull request #1960 from NaabZer/bugfix/stealth-import-mismatch
820cbb5 Nasrin committed 5 months ago
Merge pull request #1967 from unclecode/fix/mcp-ensure-ascii-cjk-encoding
1ef552f Nasrin committed 5 months ago
Merge pull request #1969 from cgseyhan/fix/async-logger-stderr-mcp-1968
be71585 Nasrin committed 5 months ago
fix: use ensure_ascii=False in MCP bridge json.dumps to preserve CJK characters
76f56af Soham Kukreti committed 6 months ago
Change browser_adapter to use Stealth import instead of stealth_*
5568a9a NaabZer committed 6 months ago
Merge pull request #1951 from unclecode/fix/bedrock-provider-prefix
dfb525e Nasrin committed 6 months ago
Merge pull request #1952 from hafezparast/fix/maysam-silent-scrape-failure-1949
47a4c25 Nasrin committed 6 months ago
Merge pull request #1939 from unclecode/fix/preserve-tail-text-1938
a45c678 Nasrin committed 6 months ago
fix: log failure reason before COMPLETE and fix misleading SCRAPE ✓ (#1949)
5e5519b hafezparast committed 6 months ago
fix: add bedrock to PROVIDER_MODELS_PREFIXES so AWS credential auth works
660f49c Soham Kukreti committed 6 months ago
Merge pull request #1940 from hafezparast/fix/mermaid-sequence-fence-1043
388ce3f Nasrin committed 6 months ago
fix: broaden mermaid SVG text extraction and prevent nested fences (#1043)
dba38c7 hafezparast committed 7 months ago
Merge pull request #1934 from hafezparast/fix/maysam-dispatcher-semaphore-count-1927
4d13924 Nasrin committed 7 months ago
fix: preserve .tail text when removing empty elements (#1938)
e8f1af7 ntohidi committed 7 months ago
docs: update arun() docstring to match CrawlResultContainer return type
04985ea ntohidi committed 7 months ago
Merge pull request #1901 from hafezparast/fix/maysam-arun-type-hint-1898
35ee366 Nasrin committed 7 months ago
Merge pull request #1929 from atomic-carpenter/listen-on-all-addressess
244fbf7 Nasrin committed 7 months ago
fix: use semaphore_count default of 10 to match CrawlerRunConfig default
4e72f31 hafezparast committed 7 months ago
Merge pull request #1925 from sevenmoonlightsteps/fix/docker-llm-table-extraction-allowlist
d595679 Nasrin committed 7 months ago
Merge pull request #1845 from hafezparast/fix/maysam-mermaid-svg-text-1043
936e447 Nasrin committed 7 months ago