Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Add --detectOpenHandles because tests don't exit on Travis
Ondra Urban8fbea916a922
diff --git a/package.json b/package.jsonindex 647c12dca..ca7258f02 100644--- a/package.json+++ b/package.json@@ -40,7 +40,7 @@"build": "rm -rf ./build && babel src --out-dir build --copy-files","build-docs": "npm run clean && npm run build && node ./website/tools/build_docs.js","build-readme": "node ./tools/build_readme.js",- "test": "npm run build && jest --testTimeout=60000 --coverage",+ "test": "npm run build && jest --testTimeout=60000 --coverage --detectOpenHandles","prepare": "npm run build","prepublishOnly": "(test $TRAVIS || (echo \"Publishing is reserved to the Travis CI!\"; exit 1))","clean": "rm -rf build",