Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
Allow follow and referrer in documentation links [skip ci]
Ondra Urbaneea53e04801c
diff --git a/website/siteConfig.js b/website/siteConfig.jsindex 6c2438edb..c0e8d8670 100644--- a/website/siteConfig.js+++ b/website/siteConfig.js@@ -108,6 +108,7 @@ const siteConfig = {(md) => {extlink(md, {host: 'sdk.apify.com', // The hrefs that you DON'T want to be external+ rel: 'noopener', // We want to keep referrer and follow for analytics on apify.com});},],