🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
docs: update docs and skill with the new cli option
Karim shoair027a7cd95d01
diff --git a/agent-skill/Scrapling-Skill.zip b/agent-skill/Scrapling-Skill.zipindex 5a50283..13970c3 100644Binary files a/agent-skill/Scrapling-Skill.zip and b/agent-skill/Scrapling-Skill.zip differdiff --git a/agent-skill/Scrapling-Skill/SKILL.md b/agent-skill/Scrapling-Skill/SKILL.mdindex 980a319..e818216 100644--- a/agent-skill/Scrapling-Skill/SKILL.md+++ b/agent-skill/Scrapling-Skill/SKILL.md@@ -158,6 +158,7 @@ Both (`fetch` / `stealthy-fetch`) share options:| -H, --extra-headers | TEXT | Extra headers in format "Key: Value" (can be used multiple times) || --dns-over-https / --no-dns-over-https | None | Route DNS through Cloudflare's DoH to prevent DNS leaks when using proxies (default: False) || --block-ads / --no-block-ads | None | Block requests to ~3,500 known ad and tracker domains (default: False) |+| --executable-path | TEXT | Path to a custom Chromium-compatible browser executable. Falls back to the SCRAPLING_EXECUTABLE_PATH environment variable when not set. || --ai-targeted | None | Extract only main content and sanitize hidden elements for AI consumption (default: False). Also enables ad blocking automatically. |This option is specific to `fetch` only:diff --git a/agent-skill/Scrapling-Skill/references/mcp-server.md b/agent-skill/Scrapling-Skill/references/mcp-server.mdindex 87bb5bf..8028216 100644--- a/agent-skill/Scrapling-Skill/references/mcp-server.md+++ b/agent-skill/Scrapling-Skill/references/mcp-server.md@@ -238,6 +238,6 @@ In a Claude Desktop configuration, add the option to the server arguments:}```-You can also set the `SCRAPLING_EXECUTABLE_PATH` environment variable before starting the server. Tool calls can still pass `executable_path` directly when a single request or session needs a different browser executable.+You can also set the `SCRAPLING_EXECUTABLE_PATH` environment variable before starting the server. Tool calls can still pass `executable_path` directly when a single request or session needs a different browser executable. The `scrapling extract fetch` and `scrapling extract stealthy-fetch` CLI commands support the same `--executable-path` option and environment variable fallback.The MCP server name when registering with a client is `ScraplingServer`. The command is the path to the `scrapling` binary and the argument is `mcp`.\ No newline at end of filediff --git a/docs/cli/extract-commands.md b/docs/cli/extract-commands.mdindex b3663c9..05b0997 100644--- a/docs/cli/extract-commands.md+++ b/docs/cli/extract-commands.md@@ -293,6 +293,7 @@ We will go through each command in detail below.-H, --extra-headers TEXT Extra headers in format "Key: Value" (can be used multiple times)--dns-over-https / --no-dns-over-https Route DNS through Cloudflare's DoH to prevent DNS leaks when using proxies (default: False)--block-ads / --no-block-ads Block requests to known ad and tracker domains (default: False)+ --executable-path TEXT Path to a custom Chromium-compatible browser executable. Falls back to the SCRAPLING_EXECUTABLE_PATH environment variable when not set.--ai-targeted Extract only main content and sanitize hidden elements for AI consumption (default: False)--help Show this message and exit.```@@ -341,6 +342,7 @@ We will go through each command in detail below.-H, --extra-headers TEXT Extra headers in format "Key: Value" (can be used multiple times)--dns-over-https / --no-dns-over-https Route DNS through Cloudflare's DoH to prevent DNS leaks when using proxies (default: False)--block-ads / --no-block-ads Block requests to known ad and tracker domains (default: False)+ --executable-path TEXT Path to a custom Chromium-compatible browser executable. Falls back to the SCRAPLING_EXECUTABLE_PATH environment variable when not set.--ai-targeted Extract only main content and sanitize hidden elements for AI consumption (default: False)--help Show this message and exit.```