Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

7bfc15e
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
a3eec8e
b96582a
docs: fix position of Run on Apify logo
Martin Adámek committed 3 years ago
75302e0
docs: make Run on Apify buttons more visible
Martin Adámek committed 3 years ago
9ae8f13
34a6d94
docs: misc outdated/broken example scripts (#2079)
Jindřich Bär committed 3 years ago
d0be305
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
bfb5d5d
docs: use 4g for the runnable examples on homepage
Martin Adámek committed 3 years ago
95a2590
docs: make some examples runnable via Apify (#2076)
Martin Adámek committed 3 years ago
b9c5a68
chore(deps): update dependency puppeteer to v21.2.1
renovate[bot] committed 3 years ago
7aae26b
chore(deps): update dependency puppeteer to v21.2.0
renovate[bot] committed 3 years ago
05b88de
chore(deps): update patch/minor dependencies to v6.7.0
renovate[bot] committed 3 years ago
3846204
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
ea7e979
chore(release): v3.5.4
Apify Release Bot committed 3 years ago
bae967d
docs: add deployment section to the intro guide (#2070)
Martin Adámek committed 3 years ago
3b95f46
docs: raise node heap limits (#2067)
Martin Adámek committed 3 years ago
201f8fa
a677ec5
e726036
chore(deps): update patch/minor dependencies to v6.6.0
renovate[bot] committed 3 years ago
39518f6
chore: templates use new dataset helpers (#2059)
Jindřich Bär committed 3 years ago
9369a85
chore(release): update internal dependencies [skip ci]
Martin Adámek committed 3 years ago
742f32e
chore: fix release script
Martin Adámek committed 3 years ago
94ffbbc
chore(release): v3.5.3
Apify Release Bot committed 3 years ago
376ce93
e2a7544