Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

e310dba
50858b5
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
371eab1
chore(release): v3.13.9
Apify Release Bot committed 1 year ago
a7d7b56
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
ecc1a4d
chore(deps): update node.js to v22.17.0
renovate[bot] committed 1 year ago
6453fea
docs: `isTaskReadyFunction` can be overridden (#3022)
Jindřich Bär committed 1 year ago
e1b58dd
chore(deps): update patch/minor dependencies
renovate[bot] committed 1 year ago
523c939
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
9a08025
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
039b51e
chore(release): v3.13.8
Apify Release Bot committed 1 year ago
9ba5c2e
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
8d342b6
chore(deps): update dependency puppeteer to v24.10.1
renovate[bot] committed 1 year ago
619ecb8
af5aac3
chore: bump playwright and puppeteer (#3010)
Martin Adámek committed 1 year ago
d25815f
chore(deps): update patch/minor dependencies
renovate[bot] committed 1 year ago
4ab2f31
chore(deps): lock file maintenance (#3005)
renovate[bot] committed 1 year ago
9eaa226
docs: bump docusaurus to 3.8.1 (#3009)
Martin Adámek committed 1 year ago
6b9a348
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
f357979