Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Build and deploy docs

Ondra Urbana187832f3d16
diff --git a/docs/api/CheerioCrawler.md b/docs/api/CheerioCrawler.md
index 54ee3c72f..df26a455f 100644
--- a/docs/api/CheerioCrawler.md
+++ b/docs/api/CheerioCrawler.md
@@ -174,8 +174,7 @@ await crawler.run();
<td><code>[options.ignoreSslErrors]</code></td><td><code>Boolean</code></td><td><code>false</code></td>
</tr>
<tr>
-<td colspan="3"><p>If set to true, SSL certificate errors will be ignored. This is dependent on using the default
- request function. If using a custom <code>options.requestFunction</code>, user needs to implement this functionality.</p>
+<td colspan="3"><p>If set to true, SSL certificate errors will be ignored.</p>
</td></tr><tr>
<td><code>[options.useApifyProxy]</code></td><td><code>Boolean</code></td><td><code>false</code></td>
</tr>
diff --git a/website/package.json b/website/package.json
index 429d4a2f9..d2e9f8fd6 100644
--- a/website/package.json
+++ b/website/package.json
@@ -11,8 +11,8 @@
"prettify": "prettier --write --config ./tools/prettier.config.js ../docs/guides/*.md"
},
"devDependencies": {
- "docusaurus": "^1.10.0",
- "jsdoc-to-markdown": "^5.0.0",
+ "docusaurus": "^1.13.0",
+ "jsdoc-to-markdown": "^5.0.1",
"prettier": "^1.18.2"
}
}