Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

009756f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3b2df7f
7505a73
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c550479
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c8bdf8f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d605d3d
fix: pass on an invisible CF turnstile (#2277)
Jindřich Bär committed 2 years ago
d8734e7
chore(deps): update node.js to v20.11.0
renovate[bot] committed 2 years ago
6130ec2
docs: add hackernews button
Martin Adámek committed 2 years ago
bcd7102
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
4ada933
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
602aab6
chore(release): v3.7.2
Apify Release Bot committed 2 years ago
ebc9349
docs: Parallel Scraping guide (#2219)
Vlad Frangu committed 2 years ago
149d9b2
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
66f0338
d71d2db
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
aa077e5
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
4e7d8c8
chore(deps): update patch/minor dependencies to v3.1.0
renovate[bot] committed 2 years ago
c532ca9
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
a0af779
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
827a3cd
d19d4fe
ci: fix path to docs
Martin Adámek committed 2 years ago
a542b35
ci: skip docs build check in master
Martin Adámek committed 2 years ago
9ff7d30
docs: deploy via GH actions
Martin Adámek committed 2 years ago
1deb8fd
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
ae5df84
52b98e3
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
f2a8746
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
8a48aec