Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
202185b
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
ecb2e14
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
60557f8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
766f834
chore(deps): update patch/minor dependencies to v3.1.1
renovate[bot] committed 2 years ago
0d24c69
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a25cf04
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
193432c
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
04336dd
chore(deps): update dependency puppeteer to v21.9.0
renovate[bot] committed 2 years ago
30e071e
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c626138
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a5a05a2
fba8a72
0aed672
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
66e2933
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
dfe5152
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
d10d05f
chore(deps): update actions/cache action to v4 (#2290)
renovate[bot] committed 2 years ago
c0ec48f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e580e79
chore: fix comment on `SystemInfo.isSystemIdle`
Martin Adámek committed 2 years ago
fbc9624
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
8a56e42
84319b3
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3d2c149
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
291f61b
9699595