Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
chore(release): update internal dependencies [skip ci]
1ace5c6 Apify Release Bot committed 2 years ago
chore(release): update internal dependencies [skip ci]
2357c6f Apify Release Bot committed 2 years ago
docs: mention python version on homepage/navbar/announcement bar (#2573)
5d6f869 Martin Adámek committed 2 years ago