The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Python ai-gatewayanthropicazure-openaibedrockgatewaylangchainlitellmllmllm-gatewayllmopsmcp-gatewayopenaiopenai-proxyrustrust-aivertex-ai
test(perf): allowlist anyio TaskHandle._run_coro in event_loop_stalls (#47746)
Kerry Lu5e189c7267ba
diff --git a/tests/e2e/perf/cases/event_loop_stalls.py b/tests/e2e/perf/cases/event_loop_stalls.pyindex 0d67a98257f..8a5654cbf7b 100644--- a/tests/e2e/perf/cases/event_loop_stalls.py+++ b/tests/e2e/perf/cases/event_loop_stalls.py@@ -8,8 +8,8 @@ new hook that deep-copies the request inline all land here as a new row. Runs on`PYTHONASYNCIODEBUG=1` and `LITELLM_EVENT_LOOP=asyncio` (uvloop reports nothing and crashed under debug locally),and the runner `E2E_PERF_EVENT_LOOP=1`, so the nightly build, which sets neither, skips it. The allowlist countsare twice the highest count any of ten back-to-back local runs showed on that row (rows that showed nothing in-those ten but did in the earlier before/after legs for 46925 and 46967 get 2), so each run sits at or under half-of every cap and a listed location doubling in frequency is a failure, not a flake. The+those ten but did in the earlier before/after legs for 46925 and 46967, or in the first scheduled-lane run, get 2),+so each run sits at or under half of every cap and a listed location doubling in frequency is a failure, not a flake. The`garbage collection` bucket is the gen-2 passes the collector logs in debug mode (0.6 to 0.7 s each, one everyminute or two of this traffic, plus the ramp while the heap fills on a local whole-file run), which asyncio wouldotherwise charge to a random task; its count is the signal for a change that makes much more garbage."""@@ -44,6 +44,7 @@ CASE: Final = replace(KnownStall("run_coroutine_job", max_count=2),KnownStall("user_api_key_auth.py", max_count=2),KnownStall("route_streaming_logging_to_handler", max_count=2),+ KnownStall("TaskHandle._run_coro", max_count=2),),),)