Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Commits on master

5c0ddf3
2b4a28f
feat: expose Download objects on PlaywrightCrawlingContext (#3596)
nikitachapovskii-dev committed 6 months ago
5dc1627
chore(deps): bump hono from 4.12.12 to 4.12.14 (#3575)
dependabot[bot] committed 7 months ago
f15ec5c
c25d4f7
chore(deps): bump @apify/eslint-config to ^2.0.0 (#3562)
Martin Adámek committed 7 months ago
facd4b3
chore(deps): bump basic-ftp from 5.2.0 to 5.2.2 (#3563)
dependabot[bot] committed 7 months ago
9655f4c
88fab22
chore(deps): bump axios from 1.13.2 to 1.15.0 (#3564)
dependabot[bot] committed 7 months ago
79b6e79
chore(docs): upgrade docusaurus to 3.10.0 (#3561)
Martin Adámek committed 7 months ago
3847f48
chore(deps): bump lodash from 4.17.23 to 4.18.1 (#3560)
dependabot[bot] committed 7 months ago
be9da3e
3d392d6
chore(deps): bump vite from 7.2.2 to 7.3.2 (#3558)
dependabot[bot] committed 7 months ago
5b68f6f
a7335ed
chore(deps): bump hono from 4.12.7 to 4.12.12 (#3556)
dependabot[bot] committed 7 months ago
f966456
ci: use standalone apify-cli binary in E2E tests (#3543)
Martin Adámek committed 7 months ago
be6dbc4
docs: port docs fixes from apify-docs (#3544)
Martin Adámek committed 7 months ago
863dbca
docs: serve markdown via Accept header in nginx (#3542)
Martin Adámek committed 7 months ago
9586a6a
chore(deps): bump handlebars from 4.7.8 to 4.7.9 (#3539)
dependabot[bot] committed 7 months ago
a2d34a4