Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Docs: renamed "Getting Started Quick" to more common "Quick Start"
d8d3174 Jan Curn committed 7 years ago
Merge pull request #331 from apifytech/feature/call_fixes2
4cf28b1 Marek Trunkát committed 7 years ago
Merge branch 'develop' of github.com:apifytech/apify-js into develop
1933cc4 Ondra Urban committed 7 years ago
Merge pull request #332 from apifytech/feature/remove_www
f099b0a Marek Trunkát committed 7 years ago