Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Merge branch 'develop' into feature/sdk-review
Jan Curn committed 8 years ago
47e9ad6
Bump version
Ondra Urban committed 8 years ago
29b4cc6
Fix misnamed constant
Ondra Urban committed 8 years ago
90459ee
Fixing container URL usage in liveview
Marek Trunkat committed 8 years ago
6d0634b
Version bump
Marek Trunkat committed 8 years ago
4109e02
Fixing container URL usage in liveview
Marek Trunkat committed 8 years ago
12d887b
Updating changelog
Marek Trunkat committed 8 years ago
ba4235b
8a0ddfd
Fix typo in log message
Ondra Urban committed 8 years ago
75f189a
Resolve merge conflicts
Ondra Urban committed 8 years ago
6ca73af
Updating changelog
Marek Trunkat committed 8 years ago
fdbe083
72d10b0
Tiny refactoring and fixing tests
Marek Trunkat committed 8 years ago
6833561
Merging develop
Marek Trunkat committed 8 years ago
941b171
Updating changelog, version bump
Marek Trunkat committed 8 years ago
02ff674
"linting"
Marek Trunkat committed 8 years ago
6760cfd
Merge branch 'develop' into feature/sdk-review
Jan Curn committed 8 years ago
7ea5bc6
Writing better README.md (WIP)
Jan Curn committed 8 years ago
d10c0e5
Allow underscore in class methods
Ondra Urban committed 8 years ago
2070c31
fb03d7e
Add explicit termination of puppeteer subprocesses
Ondra Urban committed 8 years ago
b15749b
Update README.md
davidjohnbarton committed 8 years ago
872bc8d
Update README.md
davidjohnbarton committed 8 years ago
51d03b5
Update README.md
davidjohnbarton committed 8 years ago
7908f16
apify-shared version bump
Marek Trunkat committed 8 years ago
e5a56fa
56a64b4
Update of docs: Added memory param to Apify.call
Lukáš Křivka committed 8 years ago
ac7fcd1