Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

fixed capitalization.
Petr Patek committed 7 years ago
bbdbf76
fixed headers to have correct order.
Petr Patek committed 7 years ago
1be234e
fixed headers to have correct order.
Petr Patek committed 7 years ago
a83f1bd
fixed tests
Petr Patek committed 7 years ago
97b0bee
Improved Apify.main() docs
Jan Curn committed 7 years ago
5eb2f52
todo deleted.
Petr Patek committed 7 years ago
6518e6d
todo deleted.
Petr Patek committed 7 years ago
0b18779
fixed webkit test.
Petr Patek committed 7 years ago
2366353
builded docs
Petr Patek committed 7 years ago
ee43992
Improved test and streaming logic...
Petr Patek committed 7 years ago
21fa475
rewrote proposal.
Petr Patek committed 7 years ago
b4eba78
rewrote proposal.
Petr Patek committed 7 years ago
69e3794
Improve docs, bump package versions
Ondra Urban committed 7 years ago
ad847c7
1ffdb77
Build docs
Ondra Urban committed 7 years ago
4599ab0
Fixing knowledge base link
Marek Trunkat committed 7 years ago
5764b9e
Fixed docs
Jan Curn committed 7 years ago
1853bd0
Fixed docs
Jan Curn committed 7 years ago
502c87b
Fix docs [skip ci]
Ondra Urban committed 7 years ago
6f4e775
save
Petr Patek committed 7 years ago
a17d687
Build docs
Ondra Urban committed 7 years ago
6e7116e
Fix broken links in docs
Ondra Urban committed 7 years ago
c9bc6a5
Update apify-client
Ondra Urban committed 7 years ago
2c9867d
Update http-request to version without iltorb
Ondra Urban committed 7 years ago
ffba289
Attempt to fix flaky recycleDiskCache test
Ondra Urban committed 7 years ago
a15d9ef
f6f075d
Update changelog
Ondra Urban committed 7 years ago
89caa53