Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

9169eca
ad6d5b8
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
a7ca298
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
9772c1a
chore(release): v3.8.1
Apify Release Bot committed 2 years ago
9a9a63e
chore: bump to puppeteer v22.2 (#2356)
Martin Adámek committed 2 years ago
9b04573
d73c202
docs: add blog (#2354)
Martin Adámek committed 2 years ago
462464f
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
35b597d
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
1d39b78
docs: snapshot documentation version 3.8 (#2353)
Jindřich Bär committed 2 years ago
2c3793c
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
1e3b989
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
bd430d3
chore(release): v3.8.0
Apify Release Bot committed 2 years ago
36dc882
feat: adaptive playwright crawler (#2316)
Jan Buchar committed 2 years ago
8e4218a
chore(deps): lock file maintenance (#2345)
renovate[bot] committed 2 years ago
394df10
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0deae3a
feat: `KeyValueStore.recordExists()` (#2339)
Jindřich Bär committed 2 years ago
8507a65
chore(deps): update dependency puppeteer to v22.1.0
renovate[bot] committed 2 years ago
a7a5c75
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
ce1374c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
ca05a0b
docs: introduction rewrites (#2340)
TCMO committed 2 years ago
3f9c7a9
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3d14cbd
docs: add "Edit this page" button
Martin Adámek committed 2 years ago
4c42a2d
fix(puppeteer): support `puppeteer@v22` (#2337)
Martin Adámek committed 2 years ago
3cc360a