Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): bump nanoid from 5.1.9 to 5.1.16 (#4046)
dependabot[bot] committed 3 months ago
9918489
b04de35
2137c70
refactor!: Continue public API minimization (#4036)
Jan Buchar committed 3 months ago
ceb936a
ffd240d
af00b2a
41a2584
8e3194b
375b08c
75412fc
chore!: unify argument validation to zod (#3935)
Vlad Frangu committed 3 months ago
dd6e3b9