Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore: update GitHub workflow secrets (#1922)
František Nesveda committed 3 years ago
79f452b
test: use beta of apify-cli when running the e2e tests
Martin Adámek committed 3 years ago
b5c8032
chore(deps): update dependency playwright to v1.34.3
renovate[bot] committed 3 years ago
f5b412e
chore(deps): update dependency playwright to v1.34.2
renovate[bot] committed 3 years ago
b745dac
chore(deps): update dependency turbo to v1.9.9
renovate[bot] committed 3 years ago
9fc9d95
chore(deps): update dependency playwright to v1.34.1
renovate[bot] committed 3 years ago
64f8fb7
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
25fa006
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
b1ba108
7f2557c
docs: fix and update introduction tutorial (#1915)
Ondra Urban committed 3 years ago
c557f5f
chore(deps): update dependency turbo to v1.9.8
renovate[bot] committed 3 years ago
052ade6
chore(deps): update dependency puppeteer to v20.2.1
renovate[bot] committed 3 years ago
b0e7be4
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
68d5486
chore(deps): lock file maintenance
renovate[bot] committed 3 years ago
932ac4e
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
7d2f0ee
chore(release): v3.3.2
Apify Release Bot committed 3 years ago
4c929bd
chore: fix update to minimatch v9
Martin Adámek committed 3 years ago
d12d639
chore: sync lockfile and update minimatch to v9
Martin Adámek committed 3 years ago
879595c
2170c27
chore(deps): lock file maintenance (#1909)
renovate[bot] committed 3 years ago
b7da34e
ff5f76f
063dcd1
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
e75aabb
chore(deps): update dependency puppeteer to v20.1.1
renovate[bot] committed 3 years ago
71d5225
feat: RQv2 memory storage support (#1874)
Jindřich Bär committed 3 years ago
049486b