Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore: fix oxlint errors
Jindřich Bär committed 4 months ago
40631aa
chore: regenerate TypeScript API reports
Jindřich Bär committed 4 months ago
90ebb89
chore: fix master-v4 rebase issues
Jindřich Bär committed 4 months ago
b6eb805
test: run the browser crawler tests serially (#3859)
Martin Adámek committed 4 months ago
895978c
8f95bb2
fcca6fe
chore: fix `v4` CI build issues (#3856)
Jindřich Bär committed 4 months ago
3090359
feat: connect to remote browser services (#3545)
Richard Solar committed 4 months ago
01ab6bb
test: Eliminate MemoryStorageEmulator (#3806)
Jan Buchar committed 4 months ago
ef1654a
6c2fec0
a72033d
4f0c4c4
1dc8812
8af187d
60e9e36
feat: make `impit` the default HTTP client (#3767)
Jindřich Bär committed 5 months ago
a63239a