Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Updated docs

drobnikje32bd75e2d47
diff --git a/docs/api/CheerioCrawler.md b/docs/api/CheerioCrawler.md
index 4ea4f7a27..51e80ec57 100644
--- a/docs/api/CheerioCrawler.md
+++ b/docs/api/CheerioCrawler.md
@@ -103,7 +103,7 @@ await crawler.run();
$: Cheerio, // the Cheerio object with parsed HTML
body: String|Buffer // the request body of the web page
request: Request,
- contentType: Object, // Parsed content type
+ contentType: Object, // Parsed `Content-Type` header
response: Object // An instance of Node's http.IncomingMessage object,
autoscaledPool: AutoscaledPool
}</code></pre><p> Type of <code>body</code> depends on web page <code>Content-Type</code> header.</p>