Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Added docs
Petr Patek committed 7 years ago
a27bfe3
added docs
Petr Patek committed 7 years ago
d961488
Merge branch 'master' into develop
Ondra Urban committed 7 years ago
40a2593
Update SDK tut
Ondra Urban committed 7 years ago
11deeb4
Merge branch 'master' into develop
Ondra Urban committed 7 years ago
e7696e4
Fix broken example in SDK tut
Ondra Urban committed 7 years ago
a49c5d9
Merge pull request #339 from apifytech/fix/no-www
Ondra Urban committed 7 years ago
38105d0
Improved docs
Jan Curn committed 7 years ago
18b408d
Improved docs
Jan Curn committed 7 years ago
7058b01
Improved docs
Jan Curn committed 7 years ago
a491792
Replaced www.apify.com to apify.com in docs
Jan Curn committed 7 years ago
03bb671
repaired validation
Petr Patek committed 7 years ago
aabf2bf
Added tests. Rename function.
Petr Patek committed 7 years ago
f92c602
Docs update
Marek Trunkat committed 7 years ago
7a5fc2c
Version bump
Marek Trunkat committed 7 years ago
cd90f56
4cf28b1
Update actor.js
Marek Trunkát committed 7 years ago
e15bf5c
Update actor.js
Marek Trunkát committed 7 years ago
8e8fe13
Improved docs
Jan Curn committed 7 years ago
397662d
Docs update
Marek Trunkat committed 7 years ago
c2c2448
apify-client versin bump
Marek Trunkat committed 7 years ago
84fbabb
Fix tutorial
Ondra Urban committed 7 years ago
2da5056
Improved docs
Jan Curn committed 7 years ago
d1b0820
f099b0a
Renamed to beforeRequestFunction
Petr Patek committed 7 years ago
3a7162f
Feature preview created.
Petr Patek committed 7 years ago
6340eb0
Update changelog
Ondra Urban committed 7 years ago
1d6bd40