Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

189a04f
chore(deps): update actions/cache action to v6 (#4192)
renovate[bot] committed 1 month ago
e5968e8
c9df866
0b32f4c
82af0bd
d401355
fix: replace a retired session in `SessionPool.addSession()` (#4165)
Muhammad Haadhee Sheeraz Mian committed 1 month ago
a97a311
9e36808
chore: bump pnpm to 12 (#4169)
Martin Adámek committed 1 month ago
626d2c9
0c2162e
dd97b4d
chore(deps): bump stream-json to v3 (#4166)
Jindřich Bär committed 1 month ago
49689b8
cc99c7e
chore: Update CLAUDE.md (#4159)
Jan Buchar committed 1 month ago
6a51211
8c8ac17