Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated comments in tests
Jan Curn2be11914cf34
diff --git a/test/puppeteer_pool.js b/test/puppeteer_pool.jsindex 76ad02cd2..bc9829d76 100644--- a/test/puppeteer_pool.js+++ b/test/puppeteer_pool.js@@ -294,6 +294,7 @@ describe('PuppeteerPool', () => {expect(cookies2after.length).to.be.at.least(1);// TODO: This only works in headful mode now, but must work all the time+ // See https://bugs.chromium.org/p/chromium/issues/detail?id=882431if (isMacOs) {expect(fromDiskCache2).to.be.at.least(1);}