Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
7cd383f
ba449b2
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
0d20f92
chore(deps): update commitlint monorepo to v18 (#2136)
renovate[bot] committed 3 years ago
dff8de3
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
2ed678e
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
080a05a
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
db3be16
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
c6588c4
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
4378692
chore(release): v3.5.8
Apify Release Bot committed 3 years ago
d327244
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
86647ce
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
461385a
docs: add experiments section (#2127)
Vlad Frangu committed 3 years ago
a0bfac9
3ccd4ac
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
a829b7c
chore: update playwright to 1.39 (#2126)
Martin Adámek committed 3 years ago
a3c1969
chore: vitest (#2118)
Vlad Frangu committed 3 years ago
f448f81
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
4775d35
chore(deps): update node.js to v18.18.1
renovate[bot] committed 3 years ago
29236ac
chore(deps): update patch/minor dependencies to v6.7.5
renovate[bot] committed 3 years ago
84cea6d
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
d16525c
chore(deps): update dependency puppeteer to v21.3.8
renovate[bot] committed 3 years ago
5bce465
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
b1756f4
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
da74c20
chore(release): v3.5.7
Apify Release Bot committed 3 years ago
f28ebc1
9ab8c18