Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Improved injectJQuery() docs
Jan Curn committed 8 years ago
9ef8aa4
Build docs
Ondra Urban committed 8 years ago
583b728
Update changelog, bump version
Ondra Urban committed 8 years ago
8adc00d
Rename request.retry to noRetry
Ondra Urban committed 8 years ago
322f826
Updated docs
Jan Curn committed 8 years ago
49250ff
Fixed broken test
Jan Curn committed 8 years ago
ee61bff
Improved docs
Jan Curn committed 8 years ago
5ce731e
Client version bump
Marek Trunkat committed 8 years ago
be62700
Version bump
Marek Trunkat committed 8 years ago
f202cf1
Updating client version
Marek Trunkat committed 8 years ago
4f3d7f4
Update changelog, bump version
Ondra Urban committed 8 years ago
ec2e01d
Build docs
Ondra Urban committed 8 years ago
09121cb
Merge develop
Ondra Urban committed 8 years ago
a6f0e20
518fea4
Build docs
Ondra Urban committed 8 years ago
eba1645
Disable recycleDiskCache
Ondra Urban committed 8 years ago
af043cf
eeeed89
Merge develop
Ondra Urban committed 8 years ago
c3f250a
Build docs
Ondra Urban committed 8 years ago
9c7cb9f
Updating README.md
Marek Trunkat committed 8 years ago
1824ac8
Improved docs
Jan Curn committed 8 years ago
5e6cab3
Improved docs
Jan Curn committed 8 years ago
1bd8c27
Fixed typo in docs
Jan Curn committed 8 years ago
2652b8e
Fix request mock
Ondra Urban committed 8 years ago
d469f1e