Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated publish_docs.sh
Jan Curncd8c8003a001
diff --git a/website/i18n/en.json b/website/i18n/en.jsonindex 13b9c3e5d..273451552 100644--- a/website/i18n/en.json+++ b/website/i18n/en.json@@ -47,6 +47,9 @@"api/snapshotter": {"title": "Snapshotter"},+ "api/social": {+ "title": "social"+ },"api/systemstatus": {"title": "SystemStatus"},diff --git a/website/publish_docs.sh b/website/publish_docs.shindex e4fe107ff..45fc4b805 100755--- a/website/publish_docs.sh+++ b/website/publish_docs.sh@@ -1,5 +1,11 @@#!/bin/bash+if [ -z $1 ] || [ -z $2 ]; then+ echo "Deploys new website content to https://sdk.apify.com"+ echo "Usage: ./publish_docs.sh <ALGOLIA_API_KEY> <GITHUB_USERNAME>"+ exit 1+fi+export ALGOLIA_API_KEY=$1export GIT_USER=$2export USE_SSH=true