Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update dependency puppeteer to v21.5.2
renovate[bot] committed 3 years ago
c21d3b6
chore(docker): update docker state [skip ci]
Apify Release Bot committed 3 years ago
dba267b
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
bca9eab
chore(release): v3.6.1
Apify Release Bot committed 3 years ago
d8b66a3
fix(ts): ignore import errors for `got-scraping`
Martin Adámek committed 3 years ago
012fc9e
fix(ts): specify type explicitly for logger
Martin Adámek committed 3 years ago
aec3550
feat(puppeteer): enable `new` headless mode (#1910)
Martin Adámek committed 3 years ago
7fc999c
docs: add v3.6 snapshot
Martin Adámek committed 3 years ago
4a535a1
chore(docker): update docker state [skip ci]
Apify Release Bot committed 3 years ago
33ee0f5
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
4370b95
chore(release): v3.6.0
Apify Release Bot committed 3 years ago
ddb46cf
19f56b6
chore(docker): update docker state [skip ci]
Apify Release Bot committed 3 years ago
fa21e8a
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
1573cea
chore(deps): update yarn to v4.0.2
renovate[bot] committed 3 years ago
a369c8d
chore(deps): update dependency globby to v14 (#2177)
renovate[bot] committed 3 years ago
9a63863
feat: got-scraping v4 (#2110)
Vlad Frangu committed 3 years ago
2f05ed2
3d37f8d
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
ab561ca
28ec1ab
chore(docker): update docker state [skip ci]
Apify Release Bot committed 3 years ago
09f53fe
4e0362e
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
53114b6
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
59dc6fa
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
4e6ab90
chore(deps): update dependency puppeteer to v21.5.1
renovate[bot] committed 3 years ago
1d8ce66
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
aaeaf7f