Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(release): v3.4.2
Apify Release Bot committed 3 years ago
ef4cf65
feat: retryOnBlocked detects blocked webpage (#1956)
Jindřich Bär committed 3 years ago
766fa9b
chore(deps): update node.js to v18.17.0
renovate[bot] committed 3 years ago
8d68d0b
chore(deps): update dependency puppeteer to v20.8.3
renovate[bot] committed 3 years ago
12cb55e
chore(deps): update dependency turbo to v1.10.8
renovate[bot] committed 3 years ago
d453f9c
b518e2f
chore(deps): update dependency type-fest to v4 (#1987)
renovate[bot] committed 3 years ago
6cd3f11
chore(deps): update dependency clsx to v2 (#1986)
renovate[bot] committed 3 years ago
0e11677
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
06c06dd
chore(deps): update dependency playwright to v1.36.1
renovate[bot] committed 3 years ago
5959c48
ea5d44e
chore(release): v3.4.1
Apify Release Bot committed 3 years ago
49ad03e
test: add introduction guide e2e test (#1976)
Martin Adámek committed 3 years ago
6030a2c
chore: sync lockfiles
Martin Adámek committed 3 years ago
cc3950f
chore(deps): update dependency prettier to v3 (#1959)
renovate[bot] committed 3 years ago
eeefab6
522a9b8
0faf00d
chore(deps): bump semver from 5.7.1 to 5.7.2 (#1969)
dependabot[bot] committed 3 years ago
dfb89ff
5826f75
chore(deps): update dependency playwright to v1.36.0
renovate[bot] committed 3 years ago
55e788e
chore(deps): update dependency puppeteer to v20.8.1
renovate[bot] committed 3 years ago
b7bf3e4
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
6f0b7e6
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
0971c27
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
2764674
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
6b3fce5