Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Build and deploy docs
Ondra Urbana187832f3d16
diff --git a/docs/api/CheerioCrawler.md b/docs/api/CheerioCrawler.mdindex 54ee3c72f..df26a455f 100644--- a/docs/api/CheerioCrawler.md+++ b/docs/api/CheerioCrawler.md@@ -174,8 +174,7 @@ await crawler.run();<td><code>[options.ignoreSslErrors]</code></td><td><code>Boolean</code></td><td><code>false</code></td></tr><tr>-<td colspan="3"><p>If set to true, SSL certificate errors will be ignored. This is dependent on using the default- request function. If using a custom <code>options.requestFunction</code>, user needs to implement this functionality.</p>+<td colspan="3"><p>If set to true, SSL certificate errors will be ignored.</p></td></tr><tr><td><code>[options.useApifyProxy]</code></td><td><code>Boolean</code></td><td><code>false</code></td></tr>diff --git a/website/package.json b/website/package.jsonindex 429d4a2f9..d2e9f8fd6 100644--- a/website/package.json+++ b/website/package.json@@ -11,8 +11,8 @@"prettify": "prettier --write --config ./tools/prettier.config.js ../docs/guides/*.md"},"devDependencies": {- "docusaurus": "^1.10.0",- "jsdoc-to-markdown": "^5.0.0",+ "docusaurus": "^1.13.0",+ "jsdoc-to-markdown": "^5.0.1","prettier": "^1.18.2"}}