Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore(deps): update dependency puppeteer to v20.1.0
renovate[bot] committed 3 years ago
44646d6
chore(deps): update dependency jsdom to v22 (#1886)
renovate[bot] committed 3 years ago
653339f
1c79039
docs: fix emoji rendering on windows (#1889)
davidjohnbarton committed 3 years ago
8718889
feat(router): allow inline router definition (#1877)
Pavel 'Strajk' Dolecek committed 3 years ago
2d241c9
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
bf6f6a3
chore: ESLint comma dangle (#1885)
Pavel 'Strajk' Dolecek committed 3 years ago
940a699
chore(deps): update dependency playwright to v1.33.0
renovate[bot] committed 3 years ago
cb0eb7c
db069df
chore(deps): update dependency puppeteer to v19.11.1
renovate[bot] committed 3 years ago
339b2a9
test: add RequestQueue lruCache test (#1876)
Vlad Frangu committed 3 years ago
f649c9d
d05ec3e
chore(deps): update dependency puppeteer to v19.11.0
renovate[bot] committed 3 years ago
27f9fe4
chore(deps): update dependency puppeteer to v19.10.1
renovate[bot] committed 3 years ago
47622df
chore(deps): update dependency puppeteer to v19.10.0
renovate[bot] committed 3 years ago
9b24556
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
eb2f8f2
chore(deps): update dependency puppeteer to v19.9.0
renovate[bot] committed 3 years ago
7334e67
chore(deps): update node.js to v18.16.0
renovate[bot] committed 3 years ago
a973f48
chore(deps): update dependency turbo to v1.9.1
renovate[bot] committed 3 years ago
41c2a36
chore(deps): update patch/minor dependencies
renovate[bot] committed 3 years ago
604132c
chore(release): v3.3.1
Apify Release Bot committed 3 years ago
05c8070
chore(deps): update dependency rimraf to v5 (#1868)
renovate[bot] committed 3 years ago
74b30c0
9284fe5
8ea7a4f
chore(deps): update dependency puppeteer to v19.8.5
renovate[bot] committed 3 years ago
3aed5ca
chore: update lockfile
Martin Adámek committed 3 years ago
7fd8647