Skip to content

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.

Allow follow and referrer in documentation links [skip ci]

Ondra Urbaneea53e04801c
diff --git a/website/siteConfig.js b/website/siteConfig.js
index 6c2438edb..c0e8d8670 100644
--- a/website/siteConfig.js
+++ b/website/siteConfig.js
@@ -108,6 +108,7 @@ const siteConfig = {
(md) => {
extlink(md, {
host: 'sdk.apify.com', // The hrefs that you DON'T want to be external
+ rel: 'noopener', // We want to keep referrer and follow for analytics on apify.com
});
},
],