Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Development of better act run input/output
Jan Curn committed 9 years ago
05e119b
Development of better act run input/output
Jan Curn committed 9 years ago
e55894a
0f8b1e3
Fixed Lint errors
Jan Curn committed 9 years ago
9663491
Running build before testing or linting
Marek Trunkat committed 9 years ago
2947e25
Commenting source
Marek Trunkat committed 9 years ago
784cd04
Removing duplicite dependency
Marek Trunkat committed 9 years ago
886b0bf
Merging develop
Marek Trunkat committed 9 years ago
4f3937e
Removing build diorectory from git
Marek Trunkat committed 9 years ago
c2d49fd
Implementing key value store sdk
Marek Trunkat committed 9 years ago
4490bf6
34b0909
Merge fix
Lubos Turek committed 9 years ago
baa4a00
Merge branch 'master' into develop
Lubos Turek committed 9 years ago
8a3f01c
Crawler SDK init
Lubos Turek committed 9 years ago
a9c8d35
Upgraded packages
Jan Curn committed 9 years ago
2b36567
Fixed lint errors
Jan Curn committed 9 years ago
35b9f38
Cosmetic fix of comment
Jan Curn committed 9 years ago
4ae501c
Update actor.js
Lubos Turek committed 9 years ago
b3807c8
Update index.js
Lubos Turek committed 9 years ago
a7bad92
Updated README.md
Jan Curn committed 9 years ago
7ee13c1