Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

d57580d
chore(deps): update dependency playwright to v1.31.2
renovate[bot] committed 3 years ago
7a97d59
feat: add basic support for `setStatusMessage` (#1790)
Jindřich Bär committed 3 years ago
c318980
chore(deps): update dependency minimatch to v7 (#1795)
renovate[bot] committed 3 years ago
f1753d1
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
a8e8dc7
chore(deps): update dependency playwright to v1.31.1
renovate[bot] committed 3 years ago
6f4708a
chore(deps): update dependency turbo to v1.8.2
renovate[bot] committed 3 years ago
1ace543
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
f40e6a0
45a4577
chore(deps): update dependency turbo to v1.8.1
renovate[bot] committed 3 years ago
79538b8
chore(deps): update node.js to v18.14.1
renovate[bot] committed 3 years ago
e27f2f4
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
6de27e0
96c91e4
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
003b393
fix: add `proxyUrl` to `DownloadListOfUrlsOptions`
Martin Adámek committed 3 years ago
779be1e
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 3 years ago
9388ab3
chore(release): v3.2.2
Apify Release Bot committed 3 years ago
c324fe5
docs: better docs for fingerprint options (#1778)
Jindřich Bär committed 3 years ago
bf35e94
chore(deps): update dependency turbo to v1.7.4
renovate[bot] committed 3 years ago
bb58c00
d82cb19
cf48373