Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Merge branch 'develop' of github.com:Apifier/apify-runtime-js into feature/env_vars
d775757 Marek Trunkat committed 8 years ago
Merge pull request #162 from apifytech/feature/copywriting
cee63e3 Marek Trunkát committed 8 years ago
Merge pull request #155 from apifytech/feature/sdk-review
170fa56 Marek Trunkát committed 8 years ago