Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update yarn to v4.5.3
renovate[bot] committed 1 year ago
bc7d17f
chore(deps): lock file maintenance (#2741)
renovate[bot] committed 1 year ago
930d5cb
docs: add caching to ROA signing
Martin Adámek committed 1 year ago
4ec7868
fix: log status message timeouts to debug level
Martin Adámek committed 1 year ago
55ee44a
chore: update some dependencies (#2753)
Martin Adámek committed 1 year ago
be44aae
chore(deps): update patch/minor dependencies
renovate[bot] committed 1 year ago
197f497
docs: Last fix (#2751)
Saurav Jain committed 1 year ago
2138671
chore(deps): update yarn to v4.5.2
renovate[bot] committed 1 year ago
879793a
chore(deps): update dependency puppeteer to v23.9.0
renovate[bot] committed 1 year ago
9387f89
chore(docker): update docker state [skip ci]
Apify Release Bot committed 1 year ago
8f1d383
9e29048
docs: fix og image (#2749)
Saurav Jain committed 2 years ago
d635099
docs: add blog (#2748)
Saurav Jain committed 2 years ago
0f513d2
chore(deps): update patch/minor dependencies (#2745)
renovate[bot] committed 2 years ago
bb6ab96
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
6210c12
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
008bff8
1e59f1b
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
4e7b679
chore(deps): update dependency puppeteer to v23.7.1
renovate[bot] committed 2 years ago
60ef547
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
6b01937
docs: switch to the Apify-forked typedoc plugin (#2738)
Jindřich Bär committed 2 years ago
c8a50fb
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
a6ac40e
docs: fix hero section colors
Martin Adámek committed 2 years ago
82e0507
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
ba4c9a5
chore(deps): lock file maintenance
renovate[bot] committed 2 years ago
8b22b8d
chore(deps): update patch/minor dependencies
renovate[bot] committed 2 years ago
086e3f4
docs: update docusaurus to v3.6 (#2737)
Martin Adámek committed 2 years ago
b3147e5
docs: fix default value of `maxUsedMemoryRatio`
Martin Adámek committed 2 years ago
bab3b71
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
73625b4