Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

feat: improved cross platform metric collection (#2834)
NathanSavageKaimai committed 1 year ago
e41b2f7
chore(deps): update yarn to v4.7.0
renovate[bot] committed 1 year ago
059a33c
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
e4b10cb
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
3d670ac
chore(deps): update dependency typescript to ~5.8.0
renovate[bot] committed 1 year ago
fde4aaa
chore(deps): update dependency puppeteer to v24.3.0
renovate[bot] committed 1 year ago
bc32533
chore(deps): lock file maintenance (#2859)
renovate[bot] committed 1 year ago
4ecd067
3424d34
feat: Camoufox-based crawler template (#2842)
Jindřich Bär committed 1 year ago
7f08de4
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
bcf282b
chore: fix failing e2e tests (#2854)
Jindřich Bär committed 1 year ago
ca5397e
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
e8b518f
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
251f907
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
f14b319
docs: Mention how to install beta builds (#2850)
Jan Buchar committed 1 year ago
cbd3946
chore(deps): update dependency puppeteer to v24.2.1
renovate[bot] committed 1 year ago
cfd7e43
docs: clarify `run()` resolve condition (#2847)
Matouš Mařík committed 1 year ago
ad6fcd4
feat: use native `impit` streaming (#2833)
Jindřich Bär committed 1 year ago
af2fe23
chore(deps): update patch/minor dependencies
renovate[bot] committed 1 year ago
7e43dc1
chore(deps): lock file maintenance (#2824)
renovate[bot] committed 1 year ago
bd349df
refactor: set storage object on KV store open (#2837)
Daniil Poletaev committed 1 year ago
0bae010
d1a094a
test: skip flaky e2e test (#2839)
Martin Adámek committed 1 year ago
7bae69a
feat: remove old docker CI (#2831)
Vlad Frangu committed 1 year ago
7f09d56
chore(docker): update docker state [skip ci]
Apify Release Bot committed 1 year ago
5e6b111
9faca42