🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
docs: adding the new features
Karim shoair131b729f228d
diff --git a/docs/fetching/dynamic.md b/docs/fetching/dynamic.mdindex 5e118f6..e8ce9db 100644--- a/docs/fetching/dynamic.md+++ b/docs/fetching/dynamic.md@@ -88,6 +88,8 @@ Scrapling provides many options with this fetcher and its session classes. To ma| additional_args | Additional arguments to be passed to Playwright's context as additional settings, and they take higher priority than Scrapling's settings. | ✔️ || selector_config | A dictionary of custom parsing arguments to be used when creating the final `Selector`/`Response` class. | ✔️ || blocked_domains | A set of domain names to block requests to. Subdomains are also matched (e.g., `"example.com"` blocks `"sub.example.com"` too). | ✔️ |+| block_ads | Block requests to ~3,500 known ad/tracking domains. Can be combined with `blocked_domains`. | ✔️ |+| dns_over_https | Route DNS queries through Cloudflare's DNS-over-HTTPS to prevent DNS leaks when using proxies. | ✔️ || proxy_rotator | A `ProxyRotator` instance for automatic proxy rotation. Cannot be combined with `proxy`. | ✔️ || retries | Number of retry attempts for failed requests. Defaults to 3. | ✔️ || retry_delay | Seconds to wait between retry attempts. Defaults to 1. | ✔️ |diff --git a/docs/fetching/stealthy.md b/docs/fetching/stealthy.mdindex 22b4aec..5b7c042 100644--- a/docs/fetching/stealthy.md+++ b/docs/fetching/stealthy.md@@ -69,6 +69,8 @@ Scrapling provides many options with this fetcher and its session classes. Befor| additional_args | Additional arguments to be passed to Playwright's context as additional settings, and they take higher priority than Scrapling's settings. | ✔️ || selector_config | A dictionary of custom parsing arguments to be used when creating the final `Selector`/`Response` class. | ✔️ || blocked_domains | A set of domain names to block requests to. Subdomains are also matched (e.g., `"example.com"` blocks `"sub.example.com"` too). | ✔️ |+| block_ads | Block requests to ~3,500 known ad/tracking domains. Can be combined with `blocked_domains`. | ✔️ |+| dns_over_https | Route DNS queries through Cloudflare's DNS-over-HTTPS to prevent DNS leaks when using proxies. | ✔️ || proxy_rotator | A `ProxyRotator` instance for automatic proxy rotation. Cannot be combined with `proxy`. | ✔️ || retries | Number of retry attempts for failed requests. Defaults to 3. | ✔️ || retry_delay | Seconds to wait between retry attempts. Defaults to 1. | ✔️ |