Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
docs: Add Crawlee for Python v0.6 release blog post (#2875)
8679270 Vlada Dusek committed 1 year ago
chore: pin playwright to 1.50.1 to fix camoufox template (#2879)
017bb8e Martin Adámek committed 1 year ago
docs: add truncation marker to the latest blog post (#2873)
b4148c8 Martin Adámek committed 1 year ago
chore(release): update internal dependencies [skip ci]
6d5b13a Apify Release Bot committed 1 year ago