Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Switch back to default Web Sockets for Puppeteer
Ondra Urban committed 7 years ago
860771a
Update changelog [skip ci]
Ondra Urban committed 7 years ago
aa97e3b
Update travis configuration [skip ci]
Ondra Urban committed 7 years ago
220a85a
Format Markdown with Prettier
David Turnbull committed 7 years ago
b43959c
Fix pipe=false error
Ondra Urban committed 7 years ago
abeb2b1
Improve clickElements docs [skip ci]
Ondra Urban committed 7 years ago
87c0c00
Update version in changelog [skip ci]
Ondra Urban committed 7 years ago
b027dc9
Bump puppeteer, update changelog
Ondra Urban committed 7 years ago
2e01dd6
Added TODO
Jan Curn committed 7 years ago
9541f61
Upgraded apify-client to 0.5.22
Jan Curn committed 7 years ago
d877b1f
9adad28
Fix and build docs [skip ci]
Ondra Urban committed 7 years ago
7be9cec
Fix docs [skip ci]
Ondra Urban committed 7 years ago
9a974f9
Added a TODO
Jan Curn committed 7 years ago
4702af8
Rewrote to use the http request.
Petr Patek committed 7 years ago
4eca614
Update RELEASE.md [skip ci]
Ondra Urban committed 7 years ago
3e451ca
fix typo
Glenn Goossens committed 7 years ago
972fe15
12786fc
add links to public actors
Glenn Goossens committed 7 years ago
3109b8d
Add transformRequestFunction to enqueueLinks
Ondra Urban committed 7 years ago
1221f81
Add useExtendedUniqueKey option to Request
Ondra Urban committed 7 years ago
c301b76
Update CHANGELOG [skip ci]
Ondra Urban committed 7 years ago
f685f1d
eb0183d
build docs
vdrmota committed 7 years ago
1f71a68
Build docs
Ondra Urban committed 7 years ago
177391a
Fix tests
Ondra Urban committed 7 years ago
6b17f89
6cd27fe
605fddc