Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

test: fix cheerio test and remove logs
Martin Adámek committed 2 years ago
bae07cd
chore: pin cheerio to `1.0.0-rc.12`
Martin Adámek committed 2 years ago
61e3ed5
docs: remove banner (#2613)
Saurav Jain committed 2 years ago
90027d8
chore(deps): lock file maintenance (#2608)
renovate[bot] committed 2 years ago
07bda7e
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
5fc9802
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
26e629a
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
3324317
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
1b2a360
4b50722
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6e93ef4
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
6a21d90
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5119050
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c31afe8
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
6a5c727
docs: shorter copy (#2600)
Saurav Jain committed 2 years ago
f530b7e
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
135d14b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
8ca7677
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
22f0554
chore: fix typos (#2591)
Viktor Szépe committed 2 years ago
72b1bd7
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d79db76
docs: seo changes (#2588)
Saurav Jain committed 2 years ago
3eebc73
docs: add crawlee python mention in readme (#2593)
Saurav Jain committed 2 years ago
e52959a
docs: change announcement bar (#2592)
Saurav Jain committed 2 years ago
341255e
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e9bca90
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
ec7c8ef
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
36837b4
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
020912b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0e9cd7f
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
ff251de