Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update dependency node to v22 (#3126)
renovate[bot] committed 1 year ago
ebe1a10
948810e
f5ca450
8b9ab6c
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
69c3928
57a7051
fix: don't fail `exportData` calls on empty datasets (#3115)
MirzaSamadAhmedBaig committed 1 year ago
298f170
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
e77ad77
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
0c6de2d
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
a59c014
chore(release): v3.14.1
Apify Release Bot committed 1 year ago
ea5be17
refactor: set storage object on dataset open (#3116)
Daniil Poletaev committed 1 year ago
d4dae7f
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
c75c4f9
chore: don't skip docs build on release (#3105)
Jindřich Bär committed 1 year ago
cfdf6da
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
d5dff82
chore(release): update docs for minor version [skip ci]
Apify Release Bot committed 1 year ago
9e594db
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 1 year ago
c53f314
chore(release): v3.14.0
Apify Release Bot committed 1 year ago
ef85bd4
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
dbb0af1
6a7248c
47135a8
docs: remove `/versions` page (#3096)
Jindřich Bär committed 1 year ago
b2a7a3c
chore(deps): lock file maintenance
renovate[bot] committed 1 year ago
8158599
chore(deps): bump form-data from 4.0.3 to 4.0.4 (#3067)
dependabot[bot] committed 1 year ago
de8fada
9195b2b