Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Merge branch 'develop' of github.com:apifytech/apify-js into develop
9849f38 Ondra Urban committed 8 years ago
Merge branch 'develop' of github.com:apifytech/apify-js into develop
6f15399 Ondra Urban committed 8 years ago
Merge branch 'develop' of github.com:apifytech/apify-js into develop
9a579fe Ondra Urban committed 8 years ago
Fixing storage.remove() that doesnt remove storage from cache when saved by name
e1a0e5b Marek Trunkat committed 8 years ago