Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore: fix v4 publishing
Martin Adámek committed 1 year ago
be74290
chore: fix build
Martin Adámek committed 1 year ago
dfe017a
chore: run tests on v4 branch
Martin Adámek committed 1 year ago
d284417
chore: use `v4` dist tag
Martin Adámek committed 1 year ago
954b320
chore: skip docker image builds for v4
Martin Adámek committed 1 year ago
cbbc0bc
refactor: remove deprecated crawler options
Martin Adámek committed 1 year ago
4ddca29
refactor: convert to native ESM
Martin Adámek committed 1 year ago
cc01b18
ci: test on node 22 and 24
Martin Adámek committed 1 year ago
c7eb771
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 months ago
304bb66
chore(deps): update dependency puppeteer to v25.7.0
renovate[bot] committed 3 months ago
7667e20
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 months ago
5dbdf0e
chore(release): v3.18.1
Apify Release Bot committed 3 months ago
1bc899c
chore(deps): update dependency puppeteer to v25.6.0
renovate[bot] committed 3 months ago
e137bfc
15d95bd
chore(deps): lock file maintenance (#3821)
renovate[bot] committed 3 months ago
0cf70e9
docs: add Crawlee v3.18 release blog post (#4002)
Martin Adámek committed 3 months ago
15b35e8
a46420b
chore(deps): bump nanoid from 3.3.12 to 3.3.17 (#3994)
dependabot[bot] committed 3 months ago
2f01d8c
chore(deps): bump js-yaml from 4.3.0 to 4.3.1 (#3995)
dependabot[bot] committed 3 months ago
8b8b00b
8e8c75b
chore(deps): update dependency puppeteer to v25.5.0
renovate[bot] committed 3 months ago
0d02b74
docs: update docs for 3.18.0 version
Apify Release Bot committed 3 months ago
2de4841