Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
Merge branch 'develop' of github.com:apifytech/apify-js into develop
5fa1078 Ondra Urban committed 7 years ago
Move default live_view directory to apify_storage on local
ff4dc2a Ondra Urban committed 7 years ago
Adding dir containing complete actor for clicking testing
edefa97 Marek Trunkat committed 7 years ago
Merge branch 'master' of github.com:Apifier/apify-runtime-js into develop
b37daa9 Marek Trunkat committed 7 years ago
Merge pull request #369 from apifytech/feature/queue_consistency
8cb8a88 Marek Trunkát committed 7 years ago
Merge pull request #372 from apifytech/feature/stringifyExtended
5656752 Marek Trunkát committed 7 years ago