Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Implement, add test
Ondra Urban committed 7 years ago
89f5035
ec713fc
Update changelog
Ondra Urban committed 7 years ago
9b97275
Merge pull request #251 from apifytech/feature/docs
Ondra Urban committed 7 years ago
f0b594d
Fix unrelated flaky test
Ondra Urban committed 7 years ago
efb6b08
Initial commit
Ondra Urban committed 7 years ago
2aeb81c
Improved docs
Jan Curn committed 7 years ago
a12bc21
Fix issue, add test
Ondra Urban committed 7 years ago
902b4ca
Update actor.js
Ondra Urban committed 7 years ago
998fddf
Updating docs
Jan Curn committed 7 years ago
2327c2e
Updating docs
Jan Curn committed 7 years ago
10bde20
Merge branch 'develop' into feature/docs
Jan Curn committed 7 years ago
5cb48b4
Add log markdown
Ondra Urban committed 7 years ago
24ae305
Updating docs
Jan Curn committed 7 years ago
ad207be
Add log documentation
Ondra Urban committed 7 years ago
23d25e8
added getPublicUrl function
Aaron Jackson committed 7 years ago
a16417f
added getPublicUrl function
Aaron Jackson committed 7 years ago
bb12e97
Build docs
Ondra Urban committed 7 years ago
abb0aa8
Fix docs
Ondra Urban committed 7 years ago
865b518
Update changelog, bump version, build docs
Ondra Urban committed 7 years ago
66b3429
37bfae0
c45fa11
Update package.json
Ondra Urban committed 7 years ago
bcb19f4
Update CHANGELOG.md
Ondra Urban committed 7 years ago
8985ddf
Upgraded Puppeteer to 1.10.0
Jan Curn committed 7 years ago
5d33d2f
added getPublicUrl function to key_value_store
Aaron Jackson committed 7 years ago
5264986