Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation.
TypeScript apifyautomationcrawlercrawlingheadlessheadless-chromejavascriptnodejsnpmplaywrightpuppeteerscraperscrapingtypescriptweb-crawlerweb-crawlingweb-scraping
fix: disable default fingerprints in the Camoufox template (#2928)
Jindřich Bär6dffa00d2b20
diff --git a/docs/guides/avoid_blocking_camoufox.ts b/docs/guides/avoid_blocking_camoufox.tsindex 0149bc810..131234578 100644--- a/docs/guides/avoid_blocking_camoufox.ts+++ b/docs/guides/avoid_blocking_camoufox.ts@@ -8,6 +8,10 @@ const crawler = new PlaywrightCrawler({await handleCloudflareChallenge();},],+ browserPoolOptions: {+ // Disable the default fingerprint spoofing to avoid conflicts with Camoufox.+ useFingerprints: false,+ },launchContext: {launcher: firefox,launchOptions: await launchOptions({diff --git a/packages/templates/templates/camoufox-ts/src/main.ts b/packages/templates/templates/camoufox-ts/src/main.tsindex a6f6d6d5a..a997a2841 100644--- a/packages/templates/templates/camoufox-ts/src/main.ts+++ b/packages/templates/templates/camoufox-ts/src/main.ts@@ -12,6 +12,10 @@ const crawler = new PlaywrightCrawler({requestHandler: router,// Comment this option to scrape the full website.maxRequestsPerCrawl: 20,+ browserPoolOptions: {+ // Disable the default fingerprint spoofing to avoid conflicts with Camoufox.+ useFingerprints: false,+ },launchContext: {launcher: firefox,launchOptions: await launchOptions({