Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Commits on master
fix(browser-pool): respect user options before assigning fingerpints (#2190)
f050776 Sviatozar Petrenko committed 2 years ago
chore(release): update internal dependencies [skip ci]
9cdc34c Apify Release Bot committed 2 years ago
fix: prevent race condition in KeyValueStore.getAutoSavedValue() (#2193)
e340e2b Matěj Volf committed 2 years ago
chore: lock TS version to 5.2 in the templates due to a potential TS bug
2a42726 Martin Adámek committed 2 years ago
chore(deps): update patch/minor dependencies to v1.40.0 (#2183)
9f332b1 renovate[bot] committed 3 years ago
chore(ci): fix blunder on apify version for `@next` images
c188e0b Vlad Frangu committed 3 years ago