Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

0a88e1a
test: make enqueue-links-base e2e tests hermetic (#3674)
Martin Adámek committed 5 months ago
3773845
18ebc61
acf4490
cd4a748
chore(deps): bump fast-uri from 3.1.0 to 3.1.2 (#3638)
dependabot[bot] committed 6 months ago
10e8e28
c599424
chore(deps): bump hono from 4.12.14 to 4.12.18 (#3639)
dependabot[bot] committed 6 months ago
440e0f5
chore: bump `impit` version to `0.14.0` (#3633)
Jindřich Bär committed 6 months ago
a01fa0b
a68102a
chore(deps): bump axios from 1.15.0 to 1.16.0 (#3625)
dependabot[bot] committed 6 months ago
594bc1b
ci: bump @apify/storage-local deps in e2e tests (#3604)
Richard Solar committed 6 months ago
4dca10a
chore: update .yarnrc.yaml (#3624)
Richard Solar committed 6 months ago
cc27f0a
7deeb03
chore(deps): bump postcss from 8.5.6 to 8.5.12 (#3619)
dependabot[bot] committed 6 months ago
30a1e78
3644066