Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0c6608c
chore(deps): update patch/minor dependencies to v3.0.1
renovate[bot] committed 2 years ago
0341396
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
07f25d5
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a9c246f
e82a6e7
fix: filter out empty globs (#2205)
Jindřich Bär committed 2 years ago
41322ab
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
1daf8c7
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
7538646
f26face
322764c
chore(deps): update dependency jsdom to v23 (#2198)
renovate[bot] committed 2 years ago
b9d7a74
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d5aa254
chore(deps): update dependency lerna to v8 (#2191)
renovate[bot] committed 2 years ago
e93b291
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
995f3c9
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
2cf8c91
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
9cdc34c
chore(release): v3.6.2
Apify Release Bot committed 2 years ago
5c14fdc
ci: fix release workflow and update lockfile (#2195)
Martin Adámek committed 2 years ago
94ff36a
chore: move from ts-node to tsx (#2192)
Vlad Frangu committed 2 years ago
f405260
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
a2d7f49
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
5813d64
9f332b1
chore: fix cis (#2188)
Vlad Frangu committed 3 years ago
725f429
c188e0b
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
94f1a54
chore(docker): update docker state [skip ci]
Apify Release Bot committed 3 years ago
8682dfc
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
e1374fe