Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Update README.md
Marek Trunkát committed 8 years ago
2378872
Update README.md
Marek Trunkát committed 8 years ago
8c78d92
Updating apify shared
Marek Trunkat committed 8 years ago
df23da6
Bump version; update changelog
Ondra Urban committed 8 years ago
50ab7da
Renaming task to job
Marek Trunkat committed 8 years ago
d3cf1d6
Renaming task to job
Marek Trunkat committed 8 years ago
6b13f5f
Cosmetic fix in README
Jan Curn committed 8 years ago
6f44104
Bumped package.json version, updated CHANGELOG
Jan Curn committed 8 years ago
97f7fdd
Changed build docs directory
Jan Curn committed 8 years ago
f5a6810
817cf10
Fixed images in README
Jan Curn committed 8 years ago
b32875a
Bugfix in publish.sh
Jan Curn committed 8 years ago
ff2012d
0b5cc84
Updated README.md
Jan Curn committed 8 years ago
da873c9
Updated README.md
Jan Curn committed 8 years ago
3faa105
7fb86cc
Merge pull request #190 from 0xflotus/patch-3
Jan Čurn committed 8 years ago
c548613
Updated README
Jan Curn committed 8 years ago
9a3ba52
Updated README images
Jan Curn committed 8 years ago
0475ea4
Updated README images
Jan Curn committed 8 years ago
6c6fed7
Updated README
Jan Curn committed 8 years ago
66267c4
Updated README
Jan Curn committed 8 years ago
9734552
Updated README
Jan Curn committed 8 years ago
a488847
Do you mean 'response'?
0xflotus committed 8 years ago
bdcb79b
Updated README
Jan Curn committed 8 years ago
57d998a
Updated README
Jan Curn committed 8 years ago
0fbc328