Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

docs: update Actor SDK with Apify SDK (#1413)
Andrey Bykov committed 4 years ago
99eee76
chore: fix the default headless value usage
Martin Adámek committed 4 years ago
f1d19b9
chore(deps): update patch/minor dependencies
renovate[bot] committed 4 years ago
00b1d12
04c3b6a
7896839
b207c12
chore(deps): update dependency turbo to v1.3.2
renovate[bot] committed 4 years ago
3e721c6
00c2ba3
docs: update docusaurus
Martin Adámek committed 4 years ago
243393c
docs: update examples (#1406)
Martin Adámek committed 4 years ago
0c3e025
fix: remove trailing slash for proxyUrl (#1405)
Andrey Bykov committed 4 years ago
b57ad76
docs: disable redirect for next as its not yet branched
Martin Adámek committed 4 years ago
53ca78f
docs: add redirect from /docs to /docs/quick-start
Martin Adámek committed 4 years ago
4432014
60a9fb4
c253985
57c9cbe
docs: enable algolia
Martin Adámek committed 4 years ago
be07b6c
chore(deps): update dependency playwright to v1.23.4
renovate[bot] committed 4 years ago
474bd68
docs: revert docusaurus update
Martin Adámek committed 4 years ago
b6c96de
docs: update readme
Andrey Bykov committed 4 years ago
4d4176f
chore: update actor sdk
Martin Adámek committed 4 years ago
f28b6e3
chore: try to ignore crawlee in renovate
Martin Adámek committed 4 years ago
fb9c8a7