Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0b00d68
chore(deps): update patch/minor dependencies to v3.3.2
renovate[bot] committed 2 years ago
baed331
chore(deps): update patch/minor dependencies to v3.3.0
renovate[bot] committed 2 years ago
71b5ab1
6f541f8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c20f672
chore(deps): update yarn to v4.2.1
renovate[bot] committed 2 years ago
0d39742
chore: use node 20 in templates
Martin Adámek committed 2 years ago
d0c6817
ci: test on node 22 (#2438)
Martin Adámek committed 2 years ago
c98c157
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
72c0b0c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
01f4120
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
f89db05
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
9c2784a
docs: mitigate logotype "aliasing" on homepage (#2433)
Jindřich Bär committed 2 years ago
bb97389
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
fc00ace
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
014edbf
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
d1d1950
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d61ca93
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6026aa6
chore(deps): update dependency puppeteer to v22.7.0
renovate[bot] committed 2 years ago
2e19319
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
8b1c54a
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5687cf3
fix: Fixed double extension for screenshots (#2419)
Robert-Andrei Damian committed 2 years ago
e8b39c4
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c1a5a5e
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3099cb3
chore: update CONTRIBUTING.md (#2429)
Jan Buchar committed 2 years ago
f0b829b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
073441f
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
8ab1528