Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
4266ae4
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
6141fa5
chore(release): v3.11.5
Apify Release Bot committed 2 years ago
1c13799
6fa170f
chore(deps): update node.js to v20.18.0
renovate[bot] committed 2 years ago
d38645c
fix: `forefront` request fetching in RQv2 (#2689)
Jindřich Bär committed 2 years ago
03951bd
test: try to fix puppeteer e2e tests 2
Martin Adámek committed 2 years ago
4abb2dc
test: fix puppeteer e2e tests (#2694)
Martin Adámek committed 2 years ago
fb37c5d
chore(deps): update dependency puppeteer to v23.5.0
renovate[bot] committed 2 years ago
c916332
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
9bac207
chore: update more dependencies (#2685)
Martin Adámek committed 2 years ago
6a2aa0b
a453e58
8ef0e60
7d72bcb
chore(deps): update dependency puppeteer to v23.4.1
renovate[bot] committed 2 years ago
beb186f
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
57d024f
chore(deps): update patch/minor dependencies (#2660)
renovate[bot] committed 2 years ago
3626d1d
chore: update dependencies (#2675)
Martin Adámek committed 2 years ago
d54318c
docs: blog all posts side bar (#2664)
Saurav Jain committed 2 years ago
e68753a
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
24cc945
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
11efcc2
chore(release): v3.11.4
Apify Release Bot committed 2 years ago
20242f0
2c09ace
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
1364939