Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
1292840
chore(release): v3.10.2
Apify Release Bot committed 2 years ago
7cb86d3
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
8d6897e
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
884d7d8
chore(deps): update patch/minor dependencies to v3.4.0
renovate[bot] committed 2 years ago
35a281c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
78339d4
384ee4a
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
710bfac
docs: improve examples (#2504)
Saurav Jain committed 2 years ago
ad8be1b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
226513e
chore(deps): update node.js to v20.14.0
renovate[bot] committed 2 years ago
92e13cb
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a89079c
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
c04385b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5881603
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
bdccab8
chore(deps): update dependency puppeteer to v22.10.0
renovate[bot] committed 2 years ago
9068575
62a9f40
docs: fix homepage gradients (#2500)
Jindřich Bär committed 2 years ago
4a72a72
feat: Loading sitemaps from string (#2496)
Jan Buchar committed 2 years ago
38ed0d6
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
a5dca80
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
8195e0a
a1d1370
chore: add undeclared dependency
Martin Adámek committed 2 years ago
0a13520
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
29b8d2f
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
5333e81
chore(release): v3.10.1
Apify Release Bot committed 2 years ago
8c74d8e
chore(deps): lock file maintenance (#2495)
renovate[bot] committed 2 years ago
58bdbf7
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
f0ed696