Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(release): v3.15.2
Apify Release Bot committed 1 year ago
72cf62d
chore: update vitest to v4 (#3210)
Martin Adámek committed 1 year ago
8038b7b
chore(deps): lock file maintenance (#3196)
renovate[bot] committed 1 year ago
4427d29
chore: update lockfile (#3209)
Martin Adámek committed 1 year ago
d2723cb
fix: enable `systemInfoV2` by default (#3208)
Martin Adámek committed 1 year ago
617a343
perf: don't await `crawler.setStatusMessage` (#3207)
Lukáš Křivka committed 1 year ago
1a67ffb
chore(deps): update dependency puppeteer to v24.26.0
renovate[bot] committed 1 year ago
05960c3
51f9700
b8cba67
f05790b
chore(deps): update node.js to v22.21.0
renovate[bot] committed 1 year ago
d3613a0
chore(deps): update patch/minor dependencies
renovate[bot] committed 1 year ago
df0e2be
chore(deps): update dependency puppeteer to v24.25.0
renovate[bot] committed 1 year ago
606c31f
f658904
369b857
chore(deps): update dependency puppeteer to v24.24.1
renovate[bot] committed 1 year ago
b0b0e20
docs: fix sidebar rendering in API docs (#3194)
Jindřich Bär committed 1 year ago
80bddca
chore(deps): update dependency puppeteer to v24.24.0
renovate[bot] committed 1 year ago
c924e5a
366a172
ci: delay dependency updates for 24 hours (#3190)
Martin Adámek committed 1 year ago
ab75b8c
103229f
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
d744b32
docs: add crawlee for python v1 launch banner (#3184)
Martin Adámek committed 1 year ago
64f7107