Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update patch/minor dependencies (#1840)
renovate[bot] committed 3 years ago
6bc6ac1
95a9f94
docs: use enums in the fingerprint examples (#1834)
Jindřich Bär committed 3 years ago
ded226e
chore(deps): lock file maintenance (#1835)
renovate[bot] committed 3 years ago
5a4261c
chore: fix build
Martin Adámek committed 3 years ago
f71819d
chore: update lock file
Martin Adámek committed 3 years ago
b897734
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
9b8c42e
chore(deps): update yarn to v3.5.0
renovate[bot] committed 3 years ago
0ebdd85
50090bb
docs: fix main-wrapper alignment on desktop (#1828)
Jindřich Bär committed 3 years ago
74fde2e
chore(deps): update dependency puppeteer to v19.7.5
renovate[bot] committed 3 years ago
dde9f03
8ab159b
fix: infiniteScroll() not working in Firefox (#1826)
Jindřich Bär committed 3 years ago
4286c5d
chore: fix typo in resume instruction (#1824)
Joseph Markus committed 3 years ago
f672563
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
6d99629
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
f41697b
chore(deps): update dependency puppeteer to v19.7.4
renovate[bot] committed 3 years ago
46b9d46
chore: update lock file
Martin Adámek committed 3 years ago
3211c7f
docs: add v3.3 snapshot + update docusaurus
Martin Adámek committed 3 years ago
d21295f
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
c1123ba
chore(release): v3.3.0
Apify Release Bot committed 3 years ago
2e820aa
2e833dc
chore: try to fix docker image builds for puppeteer
Martin Adámek committed 3 years ago
4851cfd
chore(deps): lock file maintenance (#1801)
renovate[bot] committed 3 years ago
8151674
chore: bump Puppeteer version (19.7.3) (#1815)
Jindřich Bär committed 3 years ago
8ca32bd
chore(deps): update node.js to v18.15.0
renovate[bot] committed 3 years ago
f309d8e
e0865da