Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
202566e
docs: add deployment section to the homepage (#2047)
Martin Adámek committed 3 years ago
25a81c1
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
d940a59
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
f20b420
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
79dc6b0
chore(deps): update patch/minor dependencies to v6.4.1
renovate[bot] committed 3 years ago
0ae339a
fix: pin all internal dependencies (#2041)
Martin Adámek committed 3 years ago
d6f2b17
chore(release): v3.5.2
Apify Release Bot committed 3 years ago
3741578
7f6893c
chore(deps): lock file maintenance (#2016)
renovate[bot] committed 3 years ago
7165054
7ea5c41
chore(deps): update dependency puppeteer to v21.1.0
renovate[bot] committed 3 years ago
8b3694f
75e7d65
b50ef1a
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
38a6547
chore(release): v3.5.1
Apify Release Bot committed 3 years ago
b389ccd
chore(deps): update patch/minor dependencies to v6.4.0
renovate[bot] committed 3 years ago
7a5d730
chore(deps): update dependency puppeteer to v21.0.3
renovate[bot] committed 3 years ago
5773f3f
chore(deps): update dependency playwright to v1.37.0
renovate[bot] committed 3 years ago
8f2e52c
chore(deps): update node.js to v18.17.1
renovate[bot] committed 3 years ago
3afe0e6
chore(deps): update dependency puppeteer to v21.0.2
renovate[bot] committed 3 years ago
b01056d
chore(deps): update patch/minor dependencies to v6.3.0
renovate[bot] committed 3 years ago
41db708
chore(deps): update dependency puppeteer to v21.0.1
renovate[bot] committed 3 years ago
6753e28