Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

fix: old image in missing puppeteer warning
Ondra Urban committed 5 years ago
138efec
chore: improve whitespace in an error message
Ondra Urban committed 5 years ago
b911cfd
4a79b0c
chore: update intl file
Ondra Urban committed 5 years ago
96eb665
chore: build new version of docs
Ondra Urban committed 5 years ago
dc9b3ca
chore: update changelog, bump version
Ondra Urban committed 5 years ago
9fd2339
fix: broken session pool (#970)
Ondra Urban committed 5 years ago
088959f
Bump proxy-chain from 0.4.9 to 1.0.0 (#969)
dependabot-preview[bot] committed 5 years ago
c12182f
Update getting_started.md (#968)
Sapiens Malti committed 5 years ago
52efd0d
Stealth: Hotfixed tests for webdriver. (#967)
petrpatek committed 5 years ago
01b8223
docs: remove references to deprecated gotoFunction
Ondra Urban committed 5 years ago
c9cb6ce
Update question.md
Ondra Urban committed 5 years ago
8c01508
docs: update images in getting started guide (#962)
Martin Adámek committed 5 years ago
bd6a132
add LaunchOptions for both contexts (#959)
Paulo Cesar committed 5 years ago
ea2bed7
d1d8090
f60fde8
18949ed
fix Apify.call() output (#955)
Andrey Bykov committed 5 years ago
d47dcf7
docs: fix typo in TS example config
Martin Adámek committed 5 years ago
d6b5bf5
Update changelog, build docs
Ondra Urban committed 5 years ago
0baf71e
improve JSDoc for the SDK (#942)
Paulo Cesar committed 5 years ago
da9bcf3
Bump apify-shared from 0.5.9 to 0.6.0 (#933)
dependabot-preview[bot] committed 5 years ago
0028067
Bump puppeteer to match stable Chrome 89
Ondra Urban committed 5 years ago
c433242
Update getInput docs (#934)
Jan Čurn committed 5 years ago
fe32349
examples - added missing awaits (#944)
petrpatek committed 5 years ago
8638562
Update question.md
Andrey Bykov committed 5 years ago
81b99e5
Update question.md
Andrey Bykov committed 5 years ago
98f6288