Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
0c98910
docs: add crawlee python launch blog (#2567)
Saurav Jain committed 2 years ago
1404b49
docs: adjust HTML title and description
Martin Adámek committed 2 years ago
bc44745
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e0167d7
7bf8f0b
docs: trigger build
Martin Adámek committed 2 years ago
bf01cbd
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a15ab95
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
eb6b2f8
0bfbc49
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
e57d8e3
chore: update TS eslint
Martin Adámek committed 2 years ago
0d8ac78
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
139eec5
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
d81d481
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5bb6b6d
docs: add tiered proxy blog (#2552)
Saurav Jain committed 2 years ago
899c064
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
f0daf44
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
7ee98ae
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
7cd9baa
docs: compress blog pictures (webp) (#2554)
Jindřich Bär committed 2 years ago
4d718c1
docs(guides): add 'Running in web server' guide (#2543)
Lukáš Křivka committed 2 years ago
0d1f644
docs: file download examples (#2546)
Jindřich Bär committed 2 years ago
a167ec3
ab7c413
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
88816da
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
8015b2e
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
710dd88
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
46da231
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
9a24fba
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
39cf673