Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
fix(linkedom-crawler): declare cheerio as a dependency (#3620)
Martin Adámek9ffa53c7b9a4
diff --git a/packages/linkedom-crawler/package.json b/packages/linkedom-crawler/package.jsonindex 3f8b23758..d508ebb48 100644--- a/packages/linkedom-crawler/package.json+++ b/packages/linkedom-crawler/package.json@@ -52,6 +52,7 @@"@crawlee/http": "workspace:*","@crawlee/types": "workspace:*","@crawlee/utils": "workspace:*",+ "cheerio": "^1.0.0","linkedom": "^0.18.10","ow": "^2.0.0","tslib": "^2.8.1"diff --git a/pnpm-lock.yaml b/pnpm-lock.yamlindex 0806ed572..9c0f7ff73 100644--- a/pnpm-lock.yaml+++ b/pnpm-lock.yaml@@ -662,6 +662,9 @@ importers:'@crawlee/utils':specifier: workspace:*version: link:../utils+ cheerio:+ specifier: ^1.0.0+ version: 1.2.0linkedom:specifier: ^0.18.10version: 0.18.12