Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

Updated README.md, bumped package.json version
Jan Curn committed 9 years ago
995c37e
Updated README.md
Jan Curn committed 9 years ago
82398bc
Updated README.md
Jan Curn committed 9 years ago
8201b5e
Updated README.md
Jan Curn committed 9 years ago
dede82e
Updated README.md
Jan Curn committed 9 years ago
5d94182
Updated README.md
Jan Curn committed 9 years ago
4fca8b9
Simplified Apifier.main() function logic
Jan Curn committed 9 years ago
4549006
5a98fe6
Improved module exports
Jan Curn committed 9 years ago
867ad43
Bugfix in prepublishOnly event in package.json
Jan Curn committed 9 years ago
0c90567
New TODOs and new publish
Jan Curn committed 9 years ago
85ebdbb
Initial development
Jan Curn committed 9 years ago
d7ca002
Cosmetic improvements
Jan Curn committed 9 years ago
7e85457
Updated REAMDE.md
Jan Curn committed 9 years ago
6573fb2
Initial development
Jan Curn committed 9 years ago
67f3e58
Updated README.md
Jan Curn committed 10 years ago
1676f74
Fixed git repo path in package.json
Jan Curn committed 10 years ago
b669ca0
Added index.js and package.json, updated LICENSE
Jan Curn committed 10 years ago
af6a0ee
Initial commit
apifier committed 10 years ago
38a55bd