Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

docs: fix sidebar position in docs pages
Martin Adámek committed 4 years ago
23d9f61
docs: use tranparent background in blurred image
Martin Adámek committed 4 years ago
e7b7a89
docs: fix blurred logo z index
Martin Adámek committed 4 years ago
22e1988
9cd007b
docs: incorporate some redesign feedback
Martin Adámek committed 4 years ago
ba6e3b2
docs: redesign homepage (#1441)
Martin Adámek committed 4 years ago
bc1cb7b
chore(deps): update npm to v8.16.0
renovate[bot] committed 4 years ago
09e6dfd
chore(deps): update patch/minor dependencies
renovate[bot] committed 4 years ago
201272b
chore(deps): lock file maintenance
renovate[bot] committed 4 years ago
2f3d09d
chore(deps): lock file maintenance
renovate[bot] committed 4 years ago
e4e3043
chore(deps): update patch/minor dependencies
renovate[bot] committed 4 years ago
fc5f11f
333faa4
chore: bump version
Martin Adámek committed 4 years ago
b2479f9
chore: update changelog
Martin Adámek committed 4 years ago
58120fd
feat: tab as a container + proxy per page (#1417)
Szymon Marczak committed 4 years ago
71a755d
9d62d56
docs: more updates to apify_platform guide (#1430)
Andrey Bykov committed 4 years ago
2beec9c
07b7e69
chore(deps): update npm to v8.15.1
renovate[bot] committed 4 years ago
9ab277d
1810103
docs: update apify_platform guide (#1425)
Andrey Bykov committed 4 years ago
2505fd7
docs: update OG image
Martin Adámek committed 4 years ago
45c2fba
docs: use GTM instead of gtag.js
Martin Adámek committed 4 years ago
b5784dc