Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Merge pull request #329 from apifytech/feature/basic_crawler
594fb30 Marek Trunkát committed 7 years ago
Merge pull request #330 from apifytech/feature/metamorph
446c080 Marek Trunkát committed 7 years ago
Merge branch 'develop' of github.com:Apifier/apify-runtime-js into feature/getEnv
6b5c8cd Marek Trunkat committed 7 years ago
Merge branch 'develop' of github.com:Apifier/apify-runtime-js into feature/metamorph
40cd27d Marek Trunkat committed 7 years ago