Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
7684ad5
docs: Update Crawlee Python link and wording (#3180)
Martin Adámek committed 1 year ago
b4722a7
chore(deps): update dependency globby to v15 (#3178)
renovate[bot] committed 1 year ago
564eaaa
7cfe7c0
9176a21
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
fae891d
chore(release): v3.15.1
Apify Release Bot committed 1 year ago
c423e7f
3138a08
chore(deps): lock file maintenance (#3170)
renovate[bot] committed 1 year ago
25debe8
chore(deps): update patch/minor dependencies (#3050)
renovate[bot] committed 1 year ago
ca2fa7e
f69289f
2094fdd
chore(deps): update dependency lerna to v9 (#3169)
renovate[bot] committed 1 year ago
97498da
docs: update docs for minor version
Apify Release Bot committed 1 year ago
ea5d8c0
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
3f9be81
chore(release): v3.15.0
Apify Release Bot committed 1 year ago
1df0462
docs: Join llms.txt from crawlee-python (#3161)
Jan Turoň committed 1 year ago
126845a
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
3040cb6
cd8521c
chore: update `actions/setup-node` to v5 (#3157)
Martin Adámek committed 1 year ago
f5921e0
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
66c254c
docs: fix `utilities` card link on homepage (#3149)
Jan Novotný committed 1 year ago
29333aa
docs: fix typo 'luesky' → 'Bluesky' (#3145)
Damon Thomas committed 1 year ago
25b7a17
fix: `proxyUrls` list can contain `null` (#3142)
Jindřich Bär committed 1 year ago
dc39cc2
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
2a480fe