Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

96f8d96
7a1bf10
feat: Add Segment analytics [internal] (#2960)
Jan Turoň committed 1 year ago
ea35685
799afc1
4100eab
6d636c0
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
279cadb
chore(release): v3.13.3
Apify Release Bot committed 1 year ago
21ff173
chore(ci): fix e2e tests (#2946)
Vlad Frangu committed 1 year ago
b22dc2f
docs: blog How to scrape TikTok using Python (#2893)
Max Bohomolov committed 1 year ago
dc06efb
5282381
27ba74b
fix: convert `@apilink` to `@link` on build (#2949)
Martin Adámek committed 1 year ago
abe1dee
docs: small ui fixes and new og images (#2934)
Daniel Wébr committed 1 year ago
8ccaa62
chore(deps): update patch/minor dependencies (#2933)
renovate[bot] committed 1 year ago
9bc2d3d
chore: fix formatting (#2936)
Martin Adámek committed 1 year ago
382e687
7250d81
chore(deps): update vitest monorepo to v3 (#2821)
renovate[bot] committed 1 year ago
668637d
008c4c7
docs: fix missing sidebar in web server guide (#2927)
Martin Adámek committed 1 year ago
bbb13d4