Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5c22d04
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
a967f7a
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
1ace5c6
chore(release): v3.11.1
Apify Release Bot committed 2 years ago
410773a
docs: tweak the Crawlee for Python links (#2589)
Jindřich Bär committed 2 years ago
66fa61a
fix: use `getHTML` in the shadow root expansion (#2587)
Jindřich Bär committed 2 years ago
a244d62
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
7f6cb12
docs: fix links to apify sdk in the platform guide
Martin Adámek committed 2 years ago
a4b6cf6
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
5984ea2
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
fd520d9
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
2cd85bd
chore(deps): update vitest monorepo to v2 (#2572)
renovate[bot] committed 2 years ago
e328a6e
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
aded5fb
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
bd83ef3
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
1745590
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
3a3ab3b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
69a5d60
docs: remove yc launch button (#2581)
Saurav Jain committed 2 years ago
52565ad
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
24a977b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
dcdce14
chore(deps): update dependency rimraf to v6 (#2575)
renovate[bot] committed 2 years ago
20562c4
chore: bump docs version (`3.11.0`) (#2578)
Jindřich Bär committed 2 years ago
183d9f3
docs: fix navbar responsiveness
Martin Adámek committed 2 years ago
f71a403
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
b8630c3
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
3eff9ca
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
2357c6f
chore(release): v3.11.0
Apify Release Bot committed 2 years ago
47a9129
docs: add giscus comments to blog posts
Martin Adámek committed 2 years ago
3816b9e
docs: add python sitemap link to robots.txt
Martin Adámek committed 2 years ago
61d9408