Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Updated docs
drobnikje32bd75e2d47
diff --git a/docs/api/CheerioCrawler.md b/docs/api/CheerioCrawler.mdindex 4ea4f7a27..51e80ec57 100644--- a/docs/api/CheerioCrawler.md+++ b/docs/api/CheerioCrawler.md@@ -103,7 +103,7 @@ await crawler.run();$: Cheerio, // the Cheerio object with parsed HTMLbody: String|Buffer // the request body of the web pagerequest: Request,- contentType: Object, // Parsed content type+ contentType: Object, // Parsed `Content-Type` headerresponse: Object // An instance of Node's http.IncomingMessage object,autoscaledPool: AutoscaledPool}</code></pre><p> Type of <code>body</code> depends on web page <code>Content-Type</code> header.</p>