Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Fixed publish.sh - updated CloudFront distribution IDs
Jan Curn9651b3f9a14d
diff --git a/publish.sh b/publish.shindex 767b2ee57..2a7c930e5 100755--- a/publish.sh+++ b/publish.sh@@ -40,7 +40,7 @@ if [ "${BRANCH}" = "master" ]; thenRUNNING_FROM_SCRIPT=1 npm dist-tag add ${PACKAGE_NAME}@${PACKAGE_VERSION} latestecho "Copy doc to latest folder..."aws s3 cp "s3://${AWS_BUCKET}/${GIT_TAG}/" "s3://${AWS_BUCKET}/latest/" --recursive --region us-east-1 --acl public-read --cache-control "public, max-age=3600"- aws cloudfront create-invalidation --distribution-id E29XCV9LE9131X --paths "/docs/sdk/apify-runtime-js/latest/*"+ aws cloudfront create-invalidation --distribution-id E2KZVJE3BFW9XZ --paths "/docs/sdk/apify-runtime-js/latest/*"fi# Any other branch gets published as BETA and we don't allow to override tag of existing version.@@ -55,7 +55,7 @@ elseecho "Copy docs to S3 to beta folder..."aws s3 cp "s3://${AWS_BUCKET}/${GIT_TAG}/" "s3://${AWS_BUCKET}/beta/" --recursive --region us-east-1 --acl public-read --cache-control "public, max-age=3600"- aws cloudfront create-invalidation --distribution-id E29XCV9LE9131X --paths "/docs/sdk/apify-runtime-js/beta/*"+ aws cloudfront create-invalidation --distribution-id E2KZVJE3BFW9XZ --paths "/docs/sdk/apify-runtime-js/beta/*"fi