Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update dependency typescript to v6 (#3516)
renovate[bot] committed 7 months ago
1d48644
chore(deps): update dependency impit to ^0.13.0 (#3534)
renovate[bot] committed 7 months ago
516908a
5637fd2
feat: add abortDownload context helper to FileDownload (#3528)
nikitachapovskii-dev committed 7 months ago
3b3d8f6
abece11
364bf03
chore(deps): bump picomatch from 2.3.1 to 2.3.2 (#3520)
dependabot[bot] committed 7 months ago
e5bb0c6
d8d0240
chore(deps): update dependency impit to ^0.12.0 (#3519)
renovate[bot] committed 7 months ago
7831c28
21f58c4
1cfd991
chore(deps): bump flatted from 3.3.3 to 3.4.2 (#3507)
dependabot[bot] committed 8 months ago
484e7ac
d0dcb4c
chore(deps): update dependency impit to ^0.11.0 (#3491)
renovate[bot] committed 8 months ago
3d19e67
feat: Dynamic memory snapshots (#3471)
Josef Procházka committed 8 months ago
87c67dc
chore: add CLAUDE.md with project conventions (#3501)
Martin Adámek committed 8 months ago
9197295
9b127bf
chore(deps): bump file-type from 21.3.1 to 21.3.2 (#3487)
dependabot[bot] committed 8 months ago
3a1d903
chore(deps): bump lodash from 4.17.21 to 4.17.23 (#3365)
dependabot[bot] committed 8 months ago
0bf1452
78d4c46
chore(deps): bump file-type from 20.5.0 to 21.3.1 (#3475)
dependabot[bot] committed 8 months ago
37331c2
68f7a80
chore(deps): bump hono from 4.12.4 to 4.12.7 (#3486)
dependabot[bot] committed 8 months ago
f19f5ca
dd34603