Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

docs: add new blog(web scraping expert) (#2731)
Saurav Jain committed 2 years ago
948a168
docs: fix changelog format
Martin Adámek committed 2 years ago
ef6ba52
docs: add v3.12 snapshot
Martin Adámek committed 2 years ago
9cfe041
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
59f0e7a
chore(release): update internal dependencies [skip ci]
Apify Release Bot committed 2 years ago
c692fe5
chore(release): v3.12.0
Apify Release Bot committed 2 years ago
ca51091
b66784f
chore(deps): update node.js to v22 (#2729)
renovate[bot] committed 2 years ago
cfaa872
0fb3224
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
99aa278
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
69ca3cc
feat: allow using other HTTP clients (#2661)
Jan Buchar committed 2 years ago
568c655
docs: add-blog (#2716)
Saurav Jain committed 2 years ago
59b715e
chore(deps): update dependency puppeteer to v23.6.0
renovate[bot] committed 2 years ago
3baa77b
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
5df6786
b6a095c
627e5c2
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
880b7b5
802a6fe
fix: update `fingerprintGeneratorOptions` types (#2705)
Jindřich Bär committed 2 years ago
fcb098d
chore(deps): update dependency puppeteer to v23.5.3
renovate[bot] committed 2 years ago
92c6fcd
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
baf7840
chore(deps): update dependency puppeteer to v23.5.2
renovate[bot] committed 2 years ago
0495ddd
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
debe62a
dafd95c
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
e249406
docs: add Jsdom approach blog (#2687)
Saurav Jain committed 2 years ago
1c5cb67
chore(deps): update dependency puppeteer to v23.5.1
renovate[bot] committed 2 years ago
ea48d46
chore(docker): update docker state [skip ci]
Apify Release Bot committed 2 years ago
7d2c885