Skip to content

Build AI methods with your coding agent, then run them anywhere: as an MCP for chatbots, as a webapp for people, or via API for your software.

Treat 429 as reachable in check-urls; minor doc tweaks

Louis Choquel747154f59ac1
diff --git a/.badges/tests.json b/.badges/tests.json
index f718e693f..5360b3d8f 100644
--- a/.badges/tests.json
+++ b/.badges/tests.json
@@ -1,7 +1,7 @@
{
"schemaVersion": 1,
"label": "tests",
- "message": "4854",
+ "message": "4895",
"color": "blue",
"cacheSeconds": 300
}
\ No newline at end of file
diff --git a/CLAUDE.md b/CLAUDE.md
index f971f5618..4578e4eeb 100644
--- a/CLAUDE.md
+++ b/CLAUDE.md
@@ -30,7 +30,7 @@
### Running Tests
- `make agent-test` runs the full test suite and is **critical at the end of a coding session** to verify everything is good before wrapping up.
+ `make agent-test` runs the test suite and is **critical at the end of a coding session** to verify everything is good before wrapping up.
At intermediate steps during LOCAL development, it's OK to run only the tests relevant to your changes — either by calling pytest directly from the `.venv` (e.g. `.venv/bin/pytest -x -q tests/unit/path/to/test_module.py`) or using `make t TEST=TestClassName`. This applies only to local setups, not cloud agents.
diff --git a/pipelex/cli/dev_cli/commands/check_urls_cmd.py b/pipelex/cli/dev_cli/commands/check_urls_cmd.py
index 65cb5c360..83b2f9ce5 100644
--- a/pipelex/cli/dev_cli/commands/check_urls_cmd.py
+++ b/pipelex/cli/dev_cli/commands/check_urls_cmd.py
@@ -26,6 +26,12 @@ HTTP_LIMITS = httpx.Limits(max_connections=20, max_keepalive_connections=10)
# Status codes treated as OK: the URL exists but requires authentication (e.g. billing dashboards).
AUTH_REQUIRED_STATUS_CODES = {401, 403}
+# Status codes treated as OK: the URL is reachable but the probe was rate-limited or bot-blocked.
+RATE_LIMITED_STATUS_CODES = {429}
+
+# All status codes that indicate a reachable URL despite being non-2xx.
+REACHABLE_STATUS_CODES = AUTH_REQUIRED_STATUS_CODES | RATE_LIMITED_STATUS_CODES
+
class URLCheckResult(BaseModel):
"""Result of checking a single URL."""
@@ -74,7 +80,7 @@ async def check_single_url_async(
# Some servers don't support HEAD, fallback to GET
if response.status_code == 405:
response = await client.get(url)
- is_ok = response.status_code < 400 or response.status_code in AUTH_REQUIRED_STATUS_CODES
+ is_ok = response.status_code < 400 or response.status_code in REACHABLE_STATUS_CODES
return URLCheckResult(
name=name,
url=url,
@@ -174,6 +180,8 @@ def check_urls_cmd(quiet: bool = False, timeout: int = DEFAULT_TIMEOUT) -> None:
console.print(f" [dim]{escape(result.name)}[/dim] [red]✗[/red] {escape(result.error_message or '')}")
elif result.status_code in AUTH_REQUIRED_STATUS_CODES:
console.print(f" [dim]{escape(result.name)}[/dim] [yellow]✓[/yellow] {result.status_code} (auth required)")
+ elif result.status_code in RATE_LIMITED_STATUS_CODES:
+ console.print(f" [dim]{escape(result.name)}[/dim] [yellow]✓[/yellow] {result.status_code} (rate limited)")
else:
console.print(f" [dim]{escape(result.name)}[/dim] [green]✓[/green] {result.status_code}")
diff --git a/pipelex/kit/agent_rules/commands.md b/pipelex/kit/agent_rules/commands.md
index 18a229ed4..62c5c2ab1 100644
--- a/pipelex/kit/agent_rules/commands.md
+++ b/pipelex/kit/agent_rules/commands.md
@@ -28,7 +28,7 @@
## Running Tests
- `make agent-test` runs the full test suite and is **critical at the end of a coding session** to verify everything is good before wrapping up.
+ `make agent-test` runs the test suite and is **critical at the end of a coding session** to verify everything is good before wrapping up.
At intermediate steps during LOCAL development, it's OK to run only the tests relevant to your changes — either by calling pytest directly from the `.venv` (e.g. `.venv/bin/pytest -x -q tests/unit/path/to/test_module.py`) or using `make t TEST=TestClassName`. This applies only to local setups, not cloud agents.