Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
feat: add incapsula iframe selector to the blocked list (#2111)
Jindřich Bär2b17d8a797de
diff --git a/packages/utils/src/internals/blocked.ts b/packages/utils/src/internals/blocked.tsindex fb7b58a84..be78a32aa 100644--- a/packages/utils/src/internals/blocked.ts+++ b/packages/utils/src/internals/blocked.ts@@ -4,6 +4,7 @@export const RETRY_CSS_SELECTORS = ['iframe[src^="https://challenges.cloudflare.com"]','div#infoDiv0 a[href*="//www.google.com/policies/terms/"]',+ 'iframe[src*="_Incapsula_Resource"]',];/**