Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
fixed yaml
Petr Patek9580bddf70ea
diff --git a/.travis.yml b/.travis.ymlindex 3daaa9819..251e0dbae 100644--- a/.travis.yml+++ b/.travis.yml@@ -25,7 +25,7 @@ install:- npm install --no-package-lockjobs:allow_failures:- - script: node .travis/check-user-agent.js+ - script: node .travis/check-user-agent.jsinclude:- stage: testname: Lint&Docs