Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.
Python aiai-agentscrawl4ai-cloudcrawlerdata-extractionllmmarkdownmcpopen-sourceplaywrightpythonragscraperweb-crawlerweb-crawlingweb-scraping
docker: listen on all addresses
Atomic Carpentere06b19ca09f4
diff --git a/deploy/docker/supervisord.conf b/deploy/docker/supervisord.confindex a1b994aa..198a78de 100644--- a/deploy/docker/supervisord.conf+++ b/deploy/docker/supervisord.conf@@ -14,7 +14,7 @@ stderr_logfile=/dev/stderr ; Redirect redis stderr to container stderrstderr_logfile_maxbytes=0[program:gunicorn]-command=/usr/local/bin/gunicorn --bind 0.0.0.0:11235 --workers 1 --threads 4 --timeout 1800 --graceful-timeout 30 --keep-alive 300 --log-level info --worker-class uvicorn.workers.UvicornWorker server:app+command=/usr/local/bin/gunicorn --bind [::]:11235 --workers 1 --threads 4 --timeout 1800 --graceful-timeout 30 --keep-alive 300 --log-level info --worker-class uvicorn.workers.UvicornWorker server:appdirectory=/app ; Working directory for the appuser=appuser ; Run gunicorn as our non-root userautorestart=true