Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
fix: use semaphore_count default of 10 to match CrawlerRunConfig default
hafezparast4e72f31011ab
diff --git a/crawl4ai/async_webcrawler.py b/crawl4ai/async_webcrawler.pyindex 68d1f2a5..374e2ef8 100644--- a/crawl4ai/async_webcrawler.py+++ b/crawl4ai/async_webcrawler.py@@ -1029,7 +1029,7 @@ class AsyncWebCrawler:primary_cfg = config[0] if isinstance(config, list) else configmean_delay = getattr(primary_cfg, "mean_delay", 0.1)max_range = getattr(primary_cfg, "max_range", 0.3)- max_session_permit = max(1, int(getattr(primary_cfg, "semaphore_count", 5) or 5))+ max_session_permit = max(1, int(getattr(primary_cfg, "semaphore_count", 10) or 10))dispatcher = MemoryAdaptiveDispatcher(max_session_permit=max_session_permit,rate_limiter=RateLimiter(