Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(release): v3.2.1
Apify Release Bot committed 3 years ago
bcfafdb
5ec6c24
docs: publish v3.2 snapshot
Martin Adámek committed 3 years ago
5191118
chore: upadte lock file
Martin Adámek committed 3 years ago
c5d90a0
chore(release): v3.2.0
Apify Release Bot committed 3 years ago
7014152
946535f
chore(deps): update dependency turbo to v1.7.3
renovate[bot] committed 3 years ago
4c5e31a
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
5cdb60b
chore(deps): update node.js to v18.14.0
renovate[bot] committed 3 years ago
b087031
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
c20a412
chore(deps): update dependency turbo to v1.7.1
renovate[bot] committed 3 years ago
2abdcab
bc9bcc0
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
257c238
chore: pin node and yarn for volta users (#1759)
Vlad Frangu committed 3 years ago
9568ac3
chore: remove duplicate interface `QueueOperationInfo`
Martin Adámek committed 3 years ago
ab79134
fix: declare missing dependency on `tslib`
Martin Adámek committed 3 years ago
27e96c8
chore: use global cache with yarn
Martin Adámek committed 3 years ago
8bb8cbc
chore: try to fix canary and latest builds
Martin Adámek committed 3 years ago
3a03cff
chore: update playwright to v1.30.0
Martin Adámek committed 3 years ago
6fcd619
chore: try to improve yarn caching
Martin Adámek committed 3 years ago
1ef6c5f
6526e1b
fix: make `SessionOptions.sessionPool` required
Martin Adámek committed 3 years ago
7a4a349
chore(deps): update dependency minimatch to v6 (#1742)
renovate[bot] committed 3 years ago
b8fecd0
test: skip flaky test
Martin Adámek committed 3 years ago
e2e8ad2
chore(deps): update dependency rimraf to v4 (#1738)
renovate[bot] committed 3 years ago
4c1945f
chore: try to fix canary/latest release workflows
Martin Adámek committed 3 years ago
acfaf29