Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore: downgrade ts to 4.5
Martin Adámek committed 4 years ago
7f971a8
chore: remove unused eslint ignore comments
Martin Adámek committed 4 years ago
5d372cb
chore: update dependencies
Martin Adámek committed 4 years ago
4a5b25d
chore(deps): update patch/minor dependencies (#1339)
renovate[bot] committed 4 years ago
e182488
feat: add `playwright.utils.injectJQuery` (#1337)
Jindřich Bär committed 4 years ago
133de35
chore(deps): update dependency puppeteer to v13.6.0
Renovate Bot committed 4 years ago
8919531
chore(deps): update dependency playwright to v1.21.1
Renovate Bot committed 4 years ago
975cb56
fix: utils.apifyClient early instantiation (#1330)
Jindřich Bär committed 4 years ago
077c31d
c5b2934
chore(deps): update patch/minor dependencies (#1329)
renovate[bot] committed 4 years ago
c8549bc
docs: use new token for algolia
Martin Adámek committed 4 years ago
bf16148
chore: bump version
Martin Adámek committed 4 years ago
7c89d08
docs: tag v2.3 docs
Martin Adámek committed 4 years ago
3348175
docs: fix blocking guide url (#1327)
Jindřich Bär committed 4 years ago
b2b5d0f
chore: add stream feature to changelog (#1326)
Gabin Desserprit committed 4 years ago
2b81ef5
31ebd5c
chore(deps): update patch/minor dependencies
Renovate Bot committed 4 years ago
fc6a711
feat: stealth deprecation (#1314)
petrpatek committed 4 years ago
7d20ac2
fix: improve browser launcher types (#1318)
Jindřich Bär committed 4 years ago
f167db9
chore(deps): update dependency playwright to v1.20.1
Renovate Bot committed 4 years ago
c827b80
feat: instance-scoped "global" configuration (#1315)
Jindřich Bär committed 4 years ago
eab4e7f
chore(deps): update dependency playwright to v1.20.0
Renovate Bot committed 4 years ago
5cc8b4a
fix: prune CPU snapshots locally (#1313)
Martin Adámek committed 4 years ago
03b4521
chore: remove unused dependency `csv-parse`
Martin Adámek committed 4 years ago
e9979b6