Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

c7488c4
9034f08
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
77600c7
chore(release): v3.5.6
Apify Release Bot committed 3 years ago
5b85ba1
test: fix proxy rotation e2e test
Martin Adámek committed 3 years ago
5855ff3
chore(deps): update yarn to v3.6.4
renovate[bot] committed 3 years ago
b394d14
93cf279
2b17d8a
chore(deps): update patch/minor dependencies to v6.7.4
renovate[bot] committed 3 years ago
9f3538e
chore(deps): update patch/minor dependencies (#2077)
renovate[bot] committed 3 years ago
eac618c
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
6b681a4
chore(release): v3.5.5
Apify Release Bot committed 3 years ago
be2d8d9
0cafceb
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
85d2341
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
069eb0d
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
ce4792f
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
6be9641
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
ff6b2c2
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
1abc1ee
docs: add AWS / GCP deployment guides (#2084)
Jindřich Bär committed 3 years ago
13b026e
52b47d2
feat: Request Queue v2 (#1975)
Vlad Frangu committed 3 years ago
70a77ee
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
9d3e9d8