Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
1a0dd5f
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
a33cee1
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d96fa08
chore(deps): update commitlint monorepo to v19 (#2367)
renovate[bot] committed 2 years ago
a367c3b
8ba0f30
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
899f99a
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d4a381b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e82b22c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e67ea52
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
e884960
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
4ca6f4f
fix: fix detection of older puppeteer versions
Martin Adámek committed 2 years ago
890669b
docs: fix typo `ini()` -> `init()`
Martin Adámek committed 2 years ago
86ac353
docs: add line numbers to code blocks
Martin Adámek committed 2 years ago
2ffba84
84a2f17
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
739873d
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
80e061f
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6801192
chore(deps): update dependency puppeteer to v22.3.0
renovate[bot] committed 2 years ago
9630215
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
c3f1e87
af6e8c1
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
1b73ebf
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
cf22a57
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
48dc539
2ce6690
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
519ad14
chore: run docker ci hourly (#2359)
Vlad Frangu committed 2 years ago
f71ef62