Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0a51dcb
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
73a378c
docs: fix selection of gradient heading
Martin Adámek committed 2 years ago
52cfba2
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
ed5b816
docs: fix broken anchors in browser pool readme
Martin Adámek committed 2 years ago
6c12019
chore: fix lockfile
Martin Adámek committed 2 years ago
fa631cd
docs: update typedoc plugin
Martin Adámek committed 2 years ago
5ae7862
feat: `tieredProxyUrls` for ProxyConfiguration (#2348)
Jindřich Bär committed 2 years ago
5408c7f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
03d86a8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
fc03d5c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
4d245f5
chore: update dependencies except playwright (#2391)
Martin Adámek committed 2 years ago
78f451f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
7dac15c
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
d3fe4e4
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
8705f7e
chore(release): v3.8.2
Apify Release Bot committed 2 years ago
189ceb7
c778e03
fix(puppeteer): improve detection of older versions
Martin Adámek committed 2 years ago
98d4e86
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
99611c0
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
4722f9d
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
da54f25
test: use node 20 in e2e tests
Martin Adámek committed 2 years ago
94a1859
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
b20f7d8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a2de887
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
815b896
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
7db0e7e
docs: add meta title and description (#2382)
Saurav Jain committed 2 years ago
2fd0d8f
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
306fbeb
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e2986d2
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
2dce7fb