Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
test: make enqueue links tests more stable
Martin Adámek55182cec06bd
diff --git a/test/e2e/cheerio-enqueue-links/actor/main.js b/test/e2e/cheerio-enqueue-links/actor/main.jsindex 563f7bb26..e244e1406 100644--- a/test/e2e/cheerio-enqueue-links/actor/main.js+++ b/test/e2e/cheerio-enqueue-links/actor/main.js@@ -26,5 +26,5 @@ await Actor.main(async () => {},});- await crawler.run(['https://apify.com/about']);+ await crawler.run(['https://apify.com/press-kit', 'https://apify.com/about']);}, mainOptions);diff --git a/test/e2e/puppeteer-enqueue-links/actor/main.js b/test/e2e/puppeteer-enqueue-links/actor/main.jsindex d86b355ed..befa0210e 100644--- a/test/e2e/puppeteer-enqueue-links/actor/main.js+++ b/test/e2e/puppeteer-enqueue-links/actor/main.js@@ -26,5 +26,5 @@ await Actor.main(async () => {},});- await crawler.run(['https://apify.com/about']);+ await crawler.run(['https://apify.com/press-kit', 'https://apify.com/about']);}, mainOptions);