🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Updating the `disable_resources` doc-string
Karim shoairbd612bb0e26e
diff --git a/scrapling/engines/camo.py b/scrapling/engines/camo.pyindex 1514424..8e944fd 100644--- a/scrapling/engines/camo.py+++ b/scrapling/engines/camo.py@@ -25,7 +25,7 @@ class CamoufoxEngine::param headless: Run the browser in headless/hidden (default), virtual screen mode, or headful/visible mode.:param block_images: Prevent the loading of images through Firefox preferences.This can help save your proxy usage but be careful with this option as it makes some websites never finish loading.- :param disable_resources: Drop requests of unnecessary resources for speed boost.+ :param disable_resources: Drop requests of unnecessary resources for speed boost. It depends but it made requests ~25% faster in my tests for some websites.Requests dropped are of type `font`, `image`, `media`, `beacon`, `object`, `imageset`, `texttrack`, `websocket`, `csp_report`, and `stylesheet`.This can help save your proxy usage but be careful with this option as it makes some websites never finish loading.:param block_webrtc: Blocks WebRTC entirely.diff --git a/scrapling/engines/pw.py b/scrapling/engines/pw.pyindex 67ea49e..ef493dd 100644--- a/scrapling/engines/pw.py+++ b/scrapling/engines/pw.py@@ -36,7 +36,7 @@ class PlaywrightEngine:"""An engine that utilizes PlayWright library, check the `PlayWrightFetcher` class for more documentation.:param headless: Run the browser in headless/hidden (default), or headful/visible mode.- :param disable_resources: Drop requests of unnecessary resources for speed boost.+ :param disable_resources: Drop requests of unnecessary resources for speed boost. It depends but it made requests ~25% faster in my tests for some websites.Requests dropped are of type `font`, `image`, `media`, `beacon`, `object`, `imageset`, `texttrack`, `websocket`, `csp_report`, and `stylesheet`.This can help save your proxy usage but be careful with this option as it makes some websites never finish loading.:param useragent: Pass a useragent string to be used. Otherwise the fetcher will generate a real Useragent of the same browser and use it.diff --git a/scrapling/fetchers.py b/scrapling/fetchers.pyindex 80b913a..6f569ee 100644--- a/scrapling/fetchers.py+++ b/scrapling/fetchers.py@@ -80,7 +80,7 @@ class StealthyFetcher(BaseFetcher)::param headless: Run the browser in headless/hidden (default), virtual screen mode, or headful/visible mode.:param block_images: Prevent the loading of images through Firefox preferences.This can help save your proxy usage but be careful with this option as it makes some websites never finish loading.- :param disable_resources: Drop requests of unnecessary resources for speed boost.+ :param disable_resources: Drop requests of unnecessary resources for speed boost. It depends but it made requests ~25% faster in my tests for some websites.Requests dropped are of type `font`, `image`, `media`, `beacon`, `object`, `imageset`, `texttrack`, `websocket`, `csp_report`, and `stylesheet`.This can help save your proxy usage but be careful with this option as it makes some websites never finish loading.:param block_webrtc: Blocks WebRTC entirely.@@ -136,7 +136,7 @@ class PlayWrightFetcher(BaseFetcher):"""Opens up a browser and do your request based on your chosen options below.:param url: Target url.:param headless: Run the browser in headless/hidden (default), or headful/visible mode.- :param disable_resources: Drop requests of unnecessary resources for speed boost.+ :param disable_resources: Drop requests of unnecessary resources for speed boost. It depends but it made requests ~25% faster in my tests for some websites.Requests dropped are of type `font`, `image`, `media`, `beacon`, `object`, `imageset`, `texttrack`, `websocket`, `csp_report`, and `stylesheet`.This can help save your proxy usage but be careful with this option as it makes some websites never finish loading.:param useragent: Pass a useragent string to be used. Otherwise the fetcher will generate a real Useragent of the same browser and use it.