Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
builded docs
Petr Patek73c903b6e791
diff --git a/docs/api/CheerioCrawler.md b/docs/api/CheerioCrawler.mdindex 55979c92d..68d0d4ddc 100644--- a/docs/api/CheerioCrawler.md+++ b/docs/api/CheerioCrawler.md@@ -108,7 +108,8 @@ await crawler.run();request: Request,contentType: Object, // Parsed Content-Type header: { type, encoding }response: Object // An instance of Node's http.IncomingMessage object,- autoscaledPool: AutoscaledPool+ autoscaledPool: AutoscaledPool,+ session: Session}</code></pre><p> Type of <code>body</code> depends on web page <code>Content-Type</code> header.</p><ul><li><p>String for <code>text/html</code>, <code>application/xhtml+xml</code>, <code>application/xml</code> mime types</p>@@ -169,8 +170,9 @@ The exceptions are logged to the request using theThis function is suitable for setting dynamic properties such as cookies to the <a href="request"><code>Request</code></a>.</p><p> The function receives the following object as an argument:</p><pre><code>{- request: Request-}</code></pre><p> where the <a href="request"><code>Request</code></a> instance corresponds to the initialized request.</p>+ request: Request,+ session: Session+}</code></pre><p> where the <a href="request"><code>Request</code></a> instance corresponds to the initialized request and the <a href="session"><code>Session</code></a> instance corresponds to used session.</p><p> The function should modify the properties of the passed <a href="request"><code>Request</code></a> instancein place because there are already earlier references to it. Making a copy and returning it fromthis function is therefore not supported, because it would create inconsistencies where