Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Attempt to fix CheerioCrawlerOptions docs
Jan Curne32f155fe0c1
diff --git a/src/crawlers/cheerio_crawler.js b/src/crawlers/cheerio_crawler.jsindex d81aac12a..64691237f 100644--- a/src/crawlers/cheerio_crawler.js+++ b/src/crawlers/cheerio_crawler.js@@ -50,7 +50,7 @@ const DEFAULT_AUTOSCALED_POOL_OPTIONS = {* loaded and parsed by the crawler.** The function receives the following object as an argument:- * ```javascript+ * ```* {* // The Cheerio object's function with the parsed HTML.* $: Cheerio,@@ -78,6 +78,7 @@ const DEFAULT_AUTOSCALED_POOL_OPTIONS = {* session: Session* }* ```+ ** Type of `body` depends on the `Content-Type` header of the web page:* - String for `text/html`, `application/xhtml+xml`, `application/xml` MIME content types* - Buffer for others MIME content types