Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
fix: replace litellm with unclecode-litellm due to PyPI supply chain compromise
unclecode4e4a996878cf
diff --git a/pyproject.toml b/pyproject.tomlindex 5a30a9ed..ee237d5b 100644--- a/pyproject.toml+++ b/pyproject.toml@@ -18,7 +18,7 @@ dependencies = ["aiosqlite~=0.20","anyio>=4.0.0","lxml~=5.3",- "litellm @ git+https://github.com/unclecode/[email protected]",+ "unclecode-litellm==1.81.13","numpy>=1.26.0,<3","pillow>=10.4","playwright>=1.49.0",diff --git a/requirements.txt b/requirements.txtindex 9f8b77ec..9686ffc9 100644--- a/requirements.txt+++ b/requirements.txt@@ -5,7 +5,7 @@ aiohttp>=3.11.11aiosqlite~=0.20anyio>=4.0.0lxml~=5.3-litellm @ git+https://github.com/unclecode/[email protected]+unclecode-litellm==1.81.13numpy>=1.26.0,<3pillow>=10.4playwright>=1.49.0