Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Try Ubuntu Bionic on Travis
Ondra Urband476627e554a
diff --git a/.travis.yml b/.travis.ymlindex 5d935533b..2ee9656a1 100644--- a/.travis.yml+++ b/.travis.yml@@ -1,4 +1,4 @@-dist: xenial+dist: bionicsudo: falselanguage: node_jsif: (tag IS blank) OR tag =~ /^v\d+\.\d+\.\d+$/