Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Improved publish.sh
Jan Curnbbb279fec8b5
diff --git a/publish.sh b/publish.shindex 8bdacc058..d2b5601c7 100755--- a/publish.sh+++ b/publish.sh@@ -5,16 +5,17 @@ set -eRED='\033[0;31m'NC='\033[0m' # No Color+# Do this BEFORE checking there are no git changes!+echo "Generating documentation ..."+npm run build-docs+npm run build-readme+PACKAGE_NAME=`node -pe "require('./package.json').name"`PACKAGE_VERSION=`node -pe "require('./package.json').version"`BRANCH=`git status | grep 'On branch' | cut -d ' ' -f 3`BRANCH_UP_TO_DATE=`git status | grep 'nothing to commit' | tr -s \n ' '`;GIT_TAG="v${PACKAGE_VERSION}"-echo "Generating documentation ..."-npm run build-docs-npm run build-readme-if [ -z "${BRANCH_UP_TO_DATE}" ]; thenprintf "${RED}You have uncommitted changes!${NC}\n"exit 1