Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

chore: migrate `patch-package` to `pnpm patch` (#3585)
Jindřich Bär committed 7 months ago
b2e40e8
fa06fab
52bc273
cb1b984
chore: migrate from eslint/biome to oxlint/oxfmt (#3569)
Martin Adámek committed 7 months ago
1640c40
fix: clean-up cookie handling precedence rules (#3517)
Jindřich Bär committed 7 months ago
1783146
refactor: resolve last direct @apify/log calls
Richard Solar committed 7 months ago
0eda96a
docs: add custom logger guide (#3473)
Richard Solar committed 8 months ago
46c473c
6456a64
chore: Fix rebase conflict resolution errors
Jan Buchar committed 8 months ago
94603bb
chore: bump vitest to `beta`, fix failing ALS tests
Jindřich Bär committed 8 months ago
9e49c22
chore: fix tests (new error messages)
Jindřich Bär committed 8 months ago
c9a1eaf
docs: fix types in docs examples
Jindřich Bär committed 8 months ago
0d838da
chore: fix TypeScript errors in tests
Jindřich Bär committed 8 months ago
8d53131
6653fb4
chore: run linter
Jindřich Bär committed 8 months ago
181ddac
chore: Fix more build issues
Jan Buchar committed 8 months ago
51bba83
fix: Migrate StagehandCrawler to ContextPipeline
Jan Buchar committed 8 months ago
b821af2
chore: Lint
Jan Buchar committed 8 months ago
146e02e
feat: decouple log configuration from apifylog (#3399)
Richard Solar committed 8 months ago
b5bea97