Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update dependency turbo to v1.6.1
renovate[bot] committed 4 years ago
e9fa12b
feat: enable migration testing (#1583)
Szymon Marczak committed 4 years ago
ee3a68f
test: remove third-party websites from tests (#1604)
Jindřich Bär committed 4 years ago
66ad416
7ddabd6
4e63034
chore(deps): lock file maintenance
renovate[bot] committed 4 years ago
9772f27
docs: add v3.1 typedoc definitions
Martin Adámek committed 4 years ago
193075f
docs: add v3.1 snapshot
Martin Adámek committed 4 years ago
0026d45
build: run tests before stable release
Martin Adámek committed 4 years ago
ffc53e7
docs: update changelog
Martin Adámek committed 4 years ago
eabbb9f
chore(release): v3.1.0
Apify Release Bot committed 4 years ago
d28b70a
build: try to fix lerna releasing 7
Martin Adámek committed 4 years ago
dffd6c0
build: try to fix lerna releasing 6
Martin Adámek committed 4 years ago
cb761b6
chore: remove symlink to changelog
Martin Adámek committed 4 years ago
ccc5158
Revert "chore(release): v3.1.0"
Martin Adámek committed 4 years ago
762d345
chore(release): v3.1.0
Apify Release Bot committed 4 years ago
31fe3af
build: try to fix lerna releasing 5
Martin Adámek committed 4 years ago
c65822e
build: try to fix lerna releasing 4
Martin Adámek committed 4 years ago
073910a
build: try to fix lerna releasing 3
Martin Adámek committed 4 years ago
3b6dc09
build: try to fix lerna releasing 2
Martin Adámek committed 4 years ago
2ebe277
build: try to fix lerna releasing
Martin Adámek committed 4 years ago
30a8486
build: auto confirm lerna commands 2
Martin Adámek committed 4 years ago
6a0409e
build: auto confirm lerna commands
Martin Adámek committed 4 years ago
9b9d66b
f8755b6
chore(deps): update dependency playwright to v1.27.1
renovate[bot] committed 4 years ago
3e90d37
refactor: finalize DS exports to CSV/JSON (#1589)
Martin Adámek committed 4 years ago
ebf5cdd