Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated publish.sh
Jan Curna64c63e15cfc
diff --git a/publish.sh b/publish.shindex 5f846141b..6a92b7bf2 100755--- a/publish.sh+++ b/publish.sh@@ -34,6 +34,9 @@ if [ "${BRANCH}" = "master" ]; thenRUNNING_FROM_SCRIPT=1 npm dist-tag add ${PACKAGE_NAME}@${PACKAGE_VERSION} latestfi+ # TODO: We should call this automatically, and force user to have the necessary env vars set!+ echo "IMPORTANT: Now publish the new documentation by running website/publish_docs.sh !!!"+# Any other branch gets published as BETA and we don't allow to override tag of existing version.elseecho "Publishing version ${PACKAGE_VERSION} with tag \"beta\" ..."