🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
docs: fixes and adjustments
Karim shoair9e9e79d9b078
diff --git a/docs/fetching/stealthy.md b/docs/fetching/stealthy.mdindex c7dc092..489fd4f 100644--- a/docs/fetching/stealthy.md+++ b/docs/fetching/stealthy.md@@ -33,19 +33,19 @@ Before jumping to [examples](#examples), here's the full list of arguments| block_webrtc | Blocks WebRTC entirely. | ✔️ || page_action | Added for automation. Pass a function that takes the `page` object and does the necessary automation, then returns `page` again. | ✔️ || addons | List of Firefox addons to use. **Must be paths to extracted addons.** | ✔️ |-| humanize | Humanize the cursor movement. The cursor movement takes either True or the maximum duration in seconds. The cursor typically takes up to 1.5 seconds to move across the window. | ✔️ |+| humanize | Humanize the cursor movement. The cursor movement takes either True or the maximum duration in seconds. The cursor typically takes up to 1.5 seconds to move across the window. | ✔️ || allow_webgl | Enabled by default. Disabling WebGL is not recommended, as many WAFs now check if WebGL is enabled. | ✔️ || geoip | Recommended to use with proxies; Automatically use IP's longitude, latitude, timezone, country, locale, & spoof the WebRTC IP address. It will also calculate and spoof the browser's language based on the distribution of language speakers in the target region. | ✔️ || os_randomize | If enabled, Scrapling will randomize the OS fingerprints used. The default is matching the fingerprints with the current OS. | ✔️ || disable_ads | Disabled by default; this installs the `uBlock Origin` addon on the browser if enabled. | ✔️ |-| solve_cloudflare | When enabled, fetcher solves all three types of Cloudflare's Turnstile wait/captcha page before returning the response to you. | ✔️ |+| solve_cloudflare | When enabled, fetcher solves all three types of Cloudflare's Turnstile wait/captcha page before returning the response to you. | ✔️ || network_idle | Wait for the page until there are no network connections for at least 500 ms. | ✔️ || timeout | The timeout used in all operations and waits through the page. It's in milliseconds, and the default is 30000. | ✔️ || wait | The time (milliseconds) the fetcher will wait after everything finishes before closing the page and returning the `Response` object. | ✔️ || wait_selector | Wait for a specific css selector to be in a specific state. | ✔️ || wait_selector_state | Scrapling will wait for the given state to be fulfilled for the selector given with `wait_selector`. _Default state is `attached`._ | ✔️ || proxy | The proxy to be used with requests. It can be a string or a dictionary with the keys 'server', 'username', and 'password' only. | ✔️ |-| additional_args | Additional arguments to be passed to Camoufox as additional settings, and they take higher priority than Scrapling's settings. | ✔️ |+| additional_args | Additional arguments to be passed to Camoufox as additional settings, and they take higher priority than Scrapling's settings. | ✔️ || selector_config | A dictionary of custom parsing arguments to be used when creating the final `Selector`/`Response` class. | ✔️ |diff --git a/mkdocs.yml b/mkdocs.ymlindex df268e0..d455c4a 100644--- a/mkdocs.yml+++ b/mkdocs.yml@@ -62,7 +62,7 @@ theme:nav:- Introduction: index.md- Overview: overview.md- - What's New in v0.3: whats-new-v0.3.md+ - What's New in v0.3: 'https://github.com/D4Vinci/Scrapling/releases/tag/v0.3'- Performance Benchmarks: benchmarks.md- User Guide:- Parsing:@@ -88,8 +88,8 @@ nav:- API Reference:- Selector: api-reference/selector.md- Fetchers: api-reference/fetchers.md- - Custom Types: api-reference/custom-types.md- MCP Server: api-reference/mcp-server.md+ - Custom Types: api-reference/custom-types.md- Writing your retrieval system: development/adaptive_storage_system.md- Using Scrapling's custom types: development/scrapling_custom_types.md- Support and Advertisement: donate.md