Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

2bca0a2
ci: bump pr-title-check action to v1.6.1 (#4147)
Jan Buchar committed 2 months ago
0b8ecf3
chore: Update public API snapshot (#4138)
Jan Buchar committed 2 months ago
458cf6c
3a248f4
3924163
c493711
3f6f7bb
ae1283c
feat: Add an afterCommit context helper (#4110)
Jan Buchar committed 2 months ago
14bbc17
bc345b9