Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Update CHANGELOG.md
petrpatek committed 6 years ago
343366d
build docs.
Petr Patek committed 6 years ago
9cf1924
builded docs.
Petr Patek committed 6 years ago
3d21719
Added await to fix the target closed error.
Petr Patek committed 6 years ago
60a85c7
Improved RequestList docs
Jan Curn committed 6 years ago
0e64158
[fix]Fixed broken and deprecated SDK links
apienx committed 6 years ago
4b81132
Update CHANGELOG.md
Ondra Urban committed 6 years ago
b504a84
ee6db98
builded docs.
Petr Patek committed 6 years ago
77b3613
improved docs
Petr Patek committed 6 years ago
7a78a23
fixed tests
Petr Patek committed 6 years ago
95e16e4
fixed utils localEmulation.
Petr Patek committed 6 years ago
0e2644d
increased chrome version.
Petr Patek committed 6 years ago
45f7bca
created POC of local storage emulator.
Petr Patek committed 6 years ago
1f19681
Fixed tests.
Petr Patek committed 6 years ago
8408ffa
Rename constant.
Petr Patek committed 6 years ago
49feeab
Merge pull request #529 from cybairfly/master
Ondra Urban committed 6 years ago
ed391e7
Improve docs [skip ci]
Tobey committed 6 years ago
3f61a64
Improve docs [skip ci]
Tobey committed 6 years ago
e799a65
added cookie logic.
Petr Patek committed 6 years ago
3692931
refactored code.
Petr Patek committed 6 years ago
0bcdecb