Make Codex and Claude Code subscriptions go further: a local model router that gives routine agent work to economical models and keeps your strongest model for the hard parts.
Rust ai-agentsai-gatewayclaude-codecodexcoding-agentcost-optimizationdeepseekllm-gatewayllm-routerlocal-firstmodel-routingrusttask-routingtauri
docs: separate connection setup from paper latency observations (#170)
澄潭d4801baeff96
diff --git a/experiments/system-one-routing-paper/DATA-CARD.md b/experiments/system-one-routing-paper/DATA-CARD.mdindex ec16e0f7..dda0452f 100644--- a/experiments/system-one-routing-paper/DATA-CARD.md+++ b/experiments/system-one-routing-paper/DATA-CARD.md@@ -1,8 +1,30 @@# Dataset card-Research snapshot: 18 October 2026. Public packaging: 19 October 2026.-The original frozen datasets and responses were preserved locally; this package-contains public copies with separate checksums. It adds no model experiments.+Research snapshot: 18 October 2026. Public packaging and latency update:+19 October 2026. Original decision-quality datasets, labels and responses are+preserved; the latency update does not change their experimental conditions.++Appendix C's latency table uses ten frozen engineering contexts, five per+language, shared across all three backends and both formats. Selection was at+request-size quantiles of Jev 1.14's three-question requests, before inspecting+these timings. The Jev timings were already recorded on 19 October; Qwen was+then measured with the same frozen inputs and original request parameters.+All calls used one request in flight and a fresh connection. For each call,+subtract its measured connection phase before taking the median or nearest-rank+p95. The metric still includes request transport, service processing and response+handling; these ten-call cells do not establish stable tail latency or universal+model speed rankings.++The [Jev timing records](diagnostics/connection-timing.json) retain 88 calls:+40 in the original study transport condition used by the table, 40 in a separate+transport control and eight excluded warmups. The [Qwen timing records](diagnostics/qwen-connection-timing.json)+retain 22 calls: 20 table observations and two excluded warmups. All Qwen calls+returned the expected model and valid answers, without retries; they consumed+43,972 Token Plan tokens. Numeric records retain model identity, request hashes,+call order and durations, while omitting credentials, private configuration and+response contents. Original 256-call end-to-end timing observations remain in the+saved-response archives and offline report; they are not relabeled as+setup-excluded measurements.## Intended usediff --git a/experiments/system-one-routing-paper/MANIFEST.json b/experiments/system-one-routing-paper/MANIFEST.jsonindex 5d02a1fe..d57c1f91 100644--- a/experiments/system-one-routing-paper/MANIFEST.json+++ b/experiments/system-one-routing-paper/MANIFEST.json@@ -9,18 +9,18 @@},{"path": "DATA-CARD.md",- "sha256": "b9cd7dd77b5d48b8201d2a0f03257590e063399adae845d37df06d4995e5c549",- "bytes": 8900+ "sha256": "f7a7bafd2be9d13ec09c01716490c8adbd43a2f7ea8ba6c0b888cf9e2d03c8db",+ "bytes": 10398},{"path": "README.md",- "sha256": "482493ecd5f70b67c241011f7e92f2521efd6fd4a7c858016703873177fd03dd",- "bytes": 8939+ "sha256": "bc13abb550483e332cb16c9d7af235a38c689859a8406675b188b2dbe5d06672",+ "bytes": 8951},{"path": "REPRODUCE.md",- "sha256": "0399329abfd550ccddb72cde626282b85f3d522db737d4719c1f9a0d12c78276",- "bytes": 5672+ "sha256": "4156a61d958a5d6313a7cc5268f2c8d979fbad42d53207add6f11c350212f029",+ "bytes": 6523},{"path": "analysis/context_eval.py",@@ -82,6 +82,21 @@"sha256": "890eb8d1d8f8a2c52db0cf5066b411565956ffd11f36abdd88abcb61a9545880","bytes": 247770},+ {+ "path": "diagnostics/connection-timing.json",+ "sha256": "4305ad9de9906ea568bce2b0272d0f93760a48a2a3fb2d7942b82d4200dce2b9",+ "bytes": 46198+ },+ {+ "path": "diagnostics/connection_timing.py",+ "sha256": "e26c77847a08e32f117fcc913ffdaaa89c34a2fe4f317832dc82189e025eb2cf",+ "bytes": 7036+ },+ {+ "path": "diagnostics/qwen-connection-timing.json",+ "sha256": "4197c1c8ae2b16de8573fc7779c21d3f11b2f866f7c57651ed9323f604d774d8",+ "bytes": 11572+ },{"path": "execution/README.md","sha256": "f55604b7dc6a31c2f1b415c66a9766156f627d69b19abd7b2034c4696e8f2f36",@@ -234,8 +249,8 @@},{"path": "main.md",- "sha256": "30b40d7b0f165615503b5f8a178919c42a61ede6acd05c89829bc59556d5272b",- "bytes": 67396+ "sha256": "23aa59c4f9c237b90029c43eb98a24c6fd724bf1dd1d757d3dcc2bfd31d907b1",+ "bytes": 66935},{"path": "policies/engineering-direct-explicit.json",diff --git a/experiments/system-one-routing-paper/README.md b/experiments/system-one-routing-paper/README.mdindex f2f48132..b2b5ce5d 100644--- a/experiments/system-one-routing-paper/README.md+++ b/experiments/system-one-routing-paper/README.md@@ -114,7 +114,7 @@ separation, numerical settings, usage charges and transport differences remainexplicit. These disclosure limits constrain exact regeneration and service-levelreproduction. They do not convert AI review into independent human review.-Original labels and reported main tables are retained. Any proposed relabeling or+Original labels and reported decision-quality tables are retained. Any proposed relabeling oranalysis change must be explicit and separate from the frozen results. Privatereviewer submissions, invitation links, identity mappings, authentication detailsand workstation configuration are not part of the public research materials.diff --git a/experiments/system-one-routing-paper/REPRODUCE.md b/experiments/system-one-routing-paper/REPRODUCE.mdindex 74cd1b25..bbe6df52 100644--- a/experiments/system-one-routing-paper/REPRODUCE.md+++ b/experiments/system-one-routing-paper/REPRODUCE.md@@ -24,6 +24,23 @@ archives for every campaign. `--check` separately compares the recomputed reductwith `reference-results.json`; that file does not supply parsing or scoring inputs.It also checks the separate MR010_b sensitivity. A mismatch fails the command.+## Connection timing diagnostic++The existing comparison table in Appendix C is reduced from curated numeric records:++```sh+python3 experiments/system-one-routing-paper/diagnostics/connection_timing.py+python3 experiments/system-one-routing-paper/diagnostics/connection_timing.py --json+```++The first command reproduces the six-row setup-excluded latency table. The second+prints all recorded timing cells and their median connection durations. The+reducer excludes warmups, checks the original matched request pairs and the shared+ten-context sample, and subtracts each call's own connection duration before+aggregation. It contains no network execution. Qwen's 20 measured calls and two+warmups complete the same-context comparison. The original 256-call end-to-end+latency cells remain reproducible through `report`; they are a separate metric.+## What is reproduced- Matched engineering direct/three actions, component scores, cohorts, languagediff --git a/experiments/system-one-routing-paper/diagnostics/connection-timing.json b/experiments/system-one-routing-paper/diagnostics/connection-timing.jsonnew file mode 100644index 00000000..544fe693--- /dev/null+++ b/experiments/system-one-routing-paper/diagnostics/connection-timing.json@@ -0,0 +1,1445 @@+{+ "schema": "hiroute.paper.connection-timing/v1",+ "measurement_date": "2026-10-19",+ "purpose": "Supplemental transport diagnostic, not a decision-quality panel. Offline reduction of already-completed calls.",+ "source_results_sha256": "0674459a030d15659bf3f2d660c77c33048242e03d287ee9a71bc20529adab26",+ "models": {+ "jev113": "typesafe/jev-1.13-20260917",+ "jev114": "typesafe/jev-1.14-20261014"+ },+ "sampling": "Five English and five Chinese frozen engineering records, chosen at request-size quantiles 0/.25/.5/.75/1 of Jev 1.14 three-question requests. Identical ten IDs across cells.",+ "selected_ids": [+ "IG004_a_en",+ "IG023_a_en",+ "IG002_b_en",+ "IG024_a_en",+ "IG026_a_en",+ "IG004_a_zh",+ "IG021_a_reworded_zh",+ "IG010_a_zh",+ "IG018_b_zh",+ "IG026_b_zh"+ ],+ "pair_order_seed": 20261019,+ "execution": "One request in flight; fresh SSL context and connection per call; one warmup per model/format/path excluded; path order balanced 5/5 per model/format.",+ "routes": {+ "explicit_proxy": "Explicit HTTP CONNECT proxy; system-level tunnel also active.",+ "no_application_proxy": "No application proxy; system-level tunnel remains active. This is not a bare-network comparison."+ },+ "timing_definition": {+ "elapsed_ms": "Monotonic time immediately before connection through complete response reading, JSON parsing and connection closure. SSL context creation is before this timer.",+ "connect_ms": "Monotonic connection phase: DNS, TCP, explicit proxy CONNECT when applicable, and TLS.",+ "post_connection_ms": "Per-call elapsed_ms minus connect_ms, then aggregate; not isolated inference time or a keep-alive measurement."+ },+ "observed_diagnostic_charge_usd": 0.00837816,+ "records": [+ {+ "call_order": 0,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "b9c57b346e11d9361d65268658811410c20909e2c4969787f879ebc4a66636e7",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 959.195709,+ "connect_ms": 531.5045420000001+ },+ {+ "call_order": 1,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "b9c57b346e11d9361d65268658811410c20909e2c4969787f879ebc4a66636e7",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1294.839167,+ "connect_ms": 580.2189589999999+ },+ {+ "call_order": 2,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "738fa7c553ccc7e05c9f7d20c5a02ec4265dce087a639dd2604b38c199034f10",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 944.5636250000002,+ "connect_ms": 522.035958+ },+ {+ "call_order": 3,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "738fa7c553ccc7e05c9f7d20c5a02ec4265dce087a639dd2604b38c199034f10",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1164.864708,+ "connect_ms": 710.2842080000005+ },+ {+ "call_order": 4,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "011118f4d5f66f4134e59e36e9b80848706819e361d89397b55cd2b39c4bf38f",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 785.5850419999992,+ "connect_ms": 453.67391699999973+ },+ {+ "call_order": 5,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "011118f4d5f66f4134e59e36e9b80848706819e361d89397b55cd2b39c4bf38f",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1262.9052920000001,+ "connect_ms": 793.2172500000005+ },+ {+ "call_order": 6,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "e8bf9ca368a8ebf5f1052ddb6279dcc529d1cdba1b3e91d1ca066445d5d440bb",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 867.6635829999997,+ "connect_ms": 496.37308299999995+ },+ {+ "call_order": 7,+ "phase": "warmup",+ "pair_index": null,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "e8bf9ca368a8ebf5f1052ddb6279dcc529d1cdba1b3e91d1ca066445d5d440bb",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1077.2040830000008,+ "connect_ms": 608.452958+ },+ {+ "call_order": 8,+ "phase": "measured",+ "pair_index": 0,+ "case_id": "IG004_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "8cd31f575d5495cb97c723e921b97f0d68b3f76fb1f8a89e64d61a4df9effbbb",+ "request_bytes": 8429,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1017.5060830000007,+ "connect_ms": 532.1652080000003+ },+ {+ "call_order": 9,+ "phase": "measured",+ "pair_index": 0,+ "case_id": "IG004_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "8cd31f575d5495cb97c723e921b97f0d68b3f76fb1f8a89e64d61a4df9effbbb",+ "request_bytes": 8429,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 985.7527079999998,+ "connect_ms": 458.64591600000006+ },+ {+ "call_order": 10,+ "phase": "measured",+ "pair_index": 1,+ "case_id": "IG024_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "56e0eb8c0cad03d17222bef2c226a55c25b9c6fc9332b4d3022523b997112ee6",+ "request_bytes": 11500,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1126.5902920000012,+ "connect_ms": 531.9432920000011+ },+ {+ "call_order": 11,+ "phase": "measured",+ "pair_index": 1,+ "case_id": "IG024_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "56e0eb8c0cad03d17222bef2c226a55c25b9c6fc9332b4d3022523b997112ee6",+ "request_bytes": 11500,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 774.3248749999996,+ "connect_ms": 449.3917920000001+ },+ {+ "call_order": 12,+ "phase": "measured",+ "pair_index": 2,+ "case_id": "IG026_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "25e8374fe64317ee580b1aece71f7ec112214ae1d79cbf14196dfb25e77698be",+ "request_bytes": 12585,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1238.6127499999998,+ "connect_ms": 428.7025+ },+ {+ "call_order": 13,+ "phase": "measured",+ "pair_index": 2,+ "case_id": "IG026_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "25e8374fe64317ee580b1aece71f7ec112214ae1d79cbf14196dfb25e77698be",+ "request_bytes": 12585,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1237.6363749999991,+ "connect_ms": 600.420917000001+ },+ {+ "call_order": 14,+ "phase": "measured",+ "pair_index": 3,+ "case_id": "IG004_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "d231906c6e9675800da1b7299616dd693006b1ed24e3be5688636fedce277511",+ "request_bytes": 11086,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1065.864125000001,+ "connect_ms": 570.2190419999997+ },+ {+ "call_order": 15,+ "phase": "measured",+ "pair_index": 3,+ "case_id": "IG004_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "d231906c6e9675800da1b7299616dd693006b1ed24e3be5688636fedce277511",+ "request_bytes": 11086,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 809.5892910000018,+ "connect_ms": 461.7719579999999+ },+ {+ "call_order": 16,+ "phase": "measured",+ "pair_index": 4,+ "case_id": "IG026_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "825cb0ebd6c07efd49edfd19d8be1973b43a521c00fff962aacb2ad7dbca15c4",+ "request_bytes": 12492,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1273.5655000000002,+ "connect_ms": 770.415958000001+ },+ {+ "call_order": 17,+ "phase": "measured",+ "pair_index": 4,+ "case_id": "IG026_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "825cb0ebd6c07efd49edfd19d8be1973b43a521c00fff962aacb2ad7dbca15c4",+ "request_bytes": 12492,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 964.0862500000012,+ "connect_ms": 451.3151250000007+ },+ {+ "call_order": 18,+ "phase": "measured",+ "pair_index": 5,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "aa018f71dbbffb1e0bb91fe898dbf6b39914f88c0767a6c1922221930300b789",+ "request_bytes": 8608,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 868.5122499999984,+ "connect_ms": 528.6166669999978+ },+ {+ "call_order": 19,+ "phase": "measured",+ "pair_index": 5,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "aa018f71dbbffb1e0bb91fe898dbf6b39914f88c0767a6c1922221930300b789",+ "request_bytes": 8608,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1142.0849169999983,+ "connect_ms": 571.2789580000006+ },+ {+ "call_order": 20,+ "phase": "measured",+ "pair_index": 6,+ "case_id": "IG023_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "14f73c7c88b29f782022ba44de2fe7a57f760c2baf7c10aa197614ffca597a54",+ "request_bytes": 11301,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1109.7721669999992,+ "connect_ms": 631.0503339999975+ },+ {+ "call_order": 21,+ "phase": "measured",+ "pair_index": 6,+ "case_id": "IG023_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "14f73c7c88b29f782022ba44de2fe7a57f760c2baf7c10aa197614ffca597a54",+ "request_bytes": 11301,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 863.4354170000016,+ "connect_ms": 531.1610000000009+ },+ {+ "call_order": 22,+ "phase": "measured",+ "pair_index": 7,+ "case_id": "IG010_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "17c5cecb80b11e16fc16b9551556ac3224b8dee8bdb95bf8d25c4240443027b0",+ "request_bytes": 11343,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1188.9330829999985,+ "connect_ms": 692.2776249999991+ },+ {+ "call_order": 23,+ "phase": "measured",+ "pair_index": 7,+ "case_id": "IG010_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "17c5cecb80b11e16fc16b9551556ac3224b8dee8bdb95bf8d25c4240443027b0",+ "request_bytes": 11343,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 880.7407499999975,+ "connect_ms": 479.5282909999976+ },+ {+ "call_order": 24,+ "phase": "measured",+ "pair_index": 8,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "4595513e5baaffea248e66df5c019e4735295679b7b8c2f54ccaf0c8e0c50236",+ "request_bytes": 8608,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1245.8839170000006,+ "connect_ms": 551.1225419999981+ },+ {+ "call_order": 25,+ "phase": "measured",+ "pair_index": 8,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "4595513e5baaffea248e66df5c019e4735295679b7b8c2f54ccaf0c8e0c50236",+ "request_bytes": 8608,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1250.3194170000002,+ "connect_ms": 776.9257920000001+ },+ {+ "call_order": 26,+ "phase": "measured",+ "pair_index": 9,+ "case_id": "IG018_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "6f857300f690f68324954f1f5035b08f3f27c7424f67ff9171b429a316b17db2",+ "request_bytes": 11453,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1012.6632919999992,+ "connect_ms": 577.8527920000016+ },+ {+ "call_order": 27,+ "phase": "measured",+ "pair_index": 9,+ "case_id": "IG018_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "6f857300f690f68324954f1f5035b08f3f27c7424f67ff9171b429a316b17db2",+ "request_bytes": 11453,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1244.7445409999993,+ "connect_ms": 763.3853330000022+ },+ {+ "call_order": 28,+ "phase": "measured",+ "pair_index": 10,+ "case_id": "IG004_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "d1131222ff997829ebee0de20a2fbb83fb28eff9a81b9af00ffa9697e2bae0b5",+ "request_bytes": 11086,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1121.7338330000005,+ "connect_ms": 634.285165999998+ },+ {+ "call_order": 29,+ "phase": "measured",+ "pair_index": 10,+ "case_id": "IG004_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "d1131222ff997829ebee0de20a2fbb83fb28eff9a81b9af00ffa9697e2bae0b5",+ "request_bytes": 11086,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 823.3837500000014,+ "connect_ms": 486.35058300000014+ },+ {+ "call_order": 30,+ "phase": "measured",+ "pair_index": 11,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "4be62f76247c69983d237a6059d5c8c5737b4bb517a12f07ca76f80c3b6f712b",+ "request_bytes": 11265,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 791.8217920000004,+ "connect_ms": 436.4054170000031+ },+ {+ "call_order": 31,+ "phase": "measured",+ "pair_index": 11,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "4be62f76247c69983d237a6059d5c8c5737b4bb517a12f07ca76f80c3b6f712b",+ "request_bytes": 11265,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1199.7885420000002,+ "connect_ms": 725.8168749999995+ },+ {+ "call_order": 32,+ "phase": "measured",+ "pair_index": 12,+ "case_id": "IG024_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "b7c036d1ed16e77262291dc258ca648f768e359ebc9853017c563ae186f8479f",+ "request_bytes": 8843,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1091.7920420000016,+ "connect_ms": 617.9474589999998+ },+ {+ "call_order": 33,+ "phase": "measured",+ "pair_index": 12,+ "case_id": "IG024_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "b7c036d1ed16e77262291dc258ca648f768e359ebc9853017c563ae186f8479f",+ "request_bytes": 8843,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 803.9333749999997,+ "connect_ms": 462.16966700000484+ },+ {+ "call_order": 34,+ "phase": "measured",+ "pair_index": 13,+ "case_id": "IG023_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "8d55597fe8cb9186dbb2ae00293862435ce86c719c181893382d78203d664bc3",+ "request_bytes": 8644,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 986.0610830000028,+ "connect_ms": 547.4207500000006+ },+ {+ "call_order": 35,+ "phase": "measured",+ "pair_index": 13,+ "case_id": "IG023_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "8d55597fe8cb9186dbb2ae00293862435ce86c719c181893382d78203d664bc3",+ "request_bytes": 8644,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 939.9379580000016,+ "connect_ms": 591.1083750000046+ },+ {+ "call_order": 36,+ "phase": "measured",+ "pair_index": 14,+ "case_id": "IG004_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "74a6995eba6128753c4391978a16df8bc5e425700e7619e24445726be5a6bf33",+ "request_bytes": 8429,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1017.8303749999955,+ "connect_ms": 584.3308329999957+ },+ {+ "call_order": 37,+ "phase": "measured",+ "pair_index": 14,+ "case_id": "IG004_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "74a6995eba6128753c4391978a16df8bc5e425700e7619e24445726be5a6bf33",+ "request_bytes": 8429,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 829.639874999998,+ "connect_ms": 454.630250000001+ },+ {+ "call_order": 38,+ "phase": "measured",+ "pair_index": 15,+ "case_id": "IG026_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "7cf3d0e65bf12700a4e7a3fa682f03d2a06e75e282d1819794685942ca877df6",+ "request_bytes": 9835,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 973.4059999999971,+ "connect_ms": 530.9995000000001+ },+ {+ "call_order": 39,+ "phase": "measured",+ "pair_index": 15,+ "case_id": "IG026_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "7cf3d0e65bf12700a4e7a3fa682f03d2a06e75e282d1819794685942ca877df6",+ "request_bytes": 9835,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 800.5718750000028,+ "connect_ms": 482.4445420000032+ },+ {+ "call_order": 40,+ "phase": "measured",+ "pair_index": 16,+ "case_id": "IG002_b_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "3d8c280c1961a73ac834081ceb21011b6b36ee772b5b04809406e0d9adfd56c1",+ "request_bytes": 11393,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 811.9349580000019,+ "connect_ms": 449.619792+ },+ {+ "call_order": 41,+ "phase": "measured",+ "pair_index": 16,+ "case_id": "IG002_b_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "3d8c280c1961a73ac834081ceb21011b6b36ee772b5b04809406e0d9adfd56c1",+ "request_bytes": 11393,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1014.7707080000004,+ "connect_ms": 538.1528750000016+ },+ {+ "call_order": 42,+ "phase": "measured",+ "pair_index": 17,+ "case_id": "IG002_b_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "ac4ef4c0a65c42b019353d4fdcffd764eee5284232d5decbbb277d9f4b26528f",+ "request_bytes": 8736,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 820.0432090000049,+ "connect_ms": 438.1045840000013+ },+ {+ "call_order": 43,+ "phase": "measured",+ "pair_index": 17,+ "case_id": "IG002_b_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "ac4ef4c0a65c42b019353d4fdcffd764eee5284232d5decbbb277d9f4b26528f",+ "request_bytes": 8736,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1006.804499999994,+ "connect_ms": 522.3984579999978+ },+ {+ "call_order": 44,+ "phase": "measured",+ "pair_index": 18,+ "case_id": "IG026_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "3b57c8bc9a6833df31f9d39461ecf99f9d6a6d01ed8623928abe99b9c02f78f8",+ "request_bytes": 9835,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1032.8430839999996,+ "connect_ms": 507.2745000000012+ },+ {+ "call_order": 45,+ "phase": "measured",+ "pair_index": 18,+ "case_id": "IG026_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "3b57c8bc9a6833df31f9d39461ecf99f9d6a6d01ed8623928abe99b9c02f78f8",+ "request_bytes": 9835,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 860.3060000000014,+ "connect_ms": 529.8478750000015+ },+ {+ "call_order": 46,+ "phase": "measured",+ "pair_index": 19,+ "case_id": "IG002_b_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "736e12a0e63cdb0a8bd1032f86450b8395501855c8911eb1ea776000988f0d26",+ "request_bytes": 11393,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 760.280999999999,+ "connect_ms": 421.93400000000025+ },+ {+ "call_order": 47,+ "phase": "measured",+ "pair_index": 19,+ "case_id": "IG002_b_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "736e12a0e63cdb0a8bd1032f86450b8395501855c8911eb1ea776000988f0d26",+ "request_bytes": 11393,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1105.9810830000033,+ "connect_ms": 600.7159170000023+ },+ {+ "call_order": 48,+ "phase": "measured",+ "pair_index": 20,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "738fa7c553ccc7e05c9f7d20c5a02ec4265dce087a639dd2604b38c199034f10",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1091.6000420000032,+ "connect_ms": 665.0094590000037+ },+ {+ "call_order": 49,+ "phase": "measured",+ "pair_index": 20,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "738fa7c553ccc7e05c9f7d20c5a02ec4265dce087a639dd2604b38c199034f10",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 991.0659159999966,+ "connect_ms": 558.4153329999992+ },+ {+ "call_order": 50,+ "phase": "measured",+ "pair_index": 21,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "8435664b0bfe7e8ad8bebb37ce6b116d27f45adff13899c150ba83789b39f445",+ "request_bytes": 11265,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 903.3974159999971,+ "connect_ms": 566.5292079999986+ },+ {+ "call_order": 51,+ "phase": "measured",+ "pair_index": 21,+ "case_id": "IG021_a_reworded_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "8435664b0bfe7e8ad8bebb37ce6b116d27f45adff13899c150ba83789b39f445",+ "request_bytes": 11265,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1199.703249999999,+ "connect_ms": 627.4501249999958+ },+ {+ "call_order": 52,+ "phase": "measured",+ "pair_index": 22,+ "case_id": "IG018_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "36a63ef1499b65c8a53288b9f9a49c2b5eb0e5f317e3d6689f42aff5b260fd9c",+ "request_bytes": 11453,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 789.833999999999,+ "connect_ms": 445.35583399999723+ },+ {+ "call_order": 53,+ "phase": "measured",+ "pair_index": 22,+ "case_id": "IG018_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "36a63ef1499b65c8a53288b9f9a49c2b5eb0e5f317e3d6689f42aff5b260fd9c",+ "request_bytes": 11453,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1104.8802910000006,+ "connect_ms": 597.5044159999995+ },+ {+ "call_order": 54,+ "phase": "measured",+ "pair_index": 23,+ "case_id": "IG018_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "04118059edc9999dafb37e7eeb7b45f5ca4fac78317d9d9d2f5a07703aa609f6",+ "request_bytes": 8796,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 773.6881249999997,+ "connect_ms": 433.78612499999747+ },+ {+ "call_order": 55,+ "phase": "measured",+ "pair_index": 23,+ "case_id": "IG018_b_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "04118059edc9999dafb37e7eeb7b45f5ca4fac78317d9d9d2f5a07703aa609f6",+ "request_bytes": 8796,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 974.773583000001,+ "connect_ms": 489.0460410000017+ },+ {+ "call_order": 56,+ "phase": "measured",+ "pair_index": 24,+ "case_id": "IG026_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "b736cb6296ea3aa1582898fc07aa67dad23e5b57efb36948e007e618b200f353",+ "request_bytes": 9928,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 809.174917,+ "connect_ms": 422.85237499999795+ },+ {+ "call_order": 57,+ "phase": "measured",+ "pair_index": 24,+ "case_id": "IG026_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "b736cb6296ea3aa1582898fc07aa67dad23e5b57efb36948e007e618b200f353",+ "request_bytes": 9928,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1051.6152499999976,+ "connect_ms": 519.0235829999992+ },+ {+ "call_order": 58,+ "phase": "measured",+ "pair_index": 25,+ "case_id": "IG026_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "8d3063d06754d7fe891b4ce62b6e15b0ae1bc5aaba18d9f5b9fb4b2655463b7e",+ "request_bytes": 12492,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1010.9746659999956,+ "connect_ms": 508.20858299999827+ },+ {+ "call_order": 59,+ "phase": "measured",+ "pair_index": 25,+ "case_id": "IG026_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "8d3063d06754d7fe891b4ce62b6e15b0ae1bc5aaba18d9f5b9fb4b2655463b7e",+ "request_bytes": 12492,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1164.6148339999982,+ "connect_ms": 597.5244169999953+ },+ {+ "call_order": 60,+ "phase": "measured",+ "pair_index": 26,+ "case_id": "IG002_b_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "3990f5b3f78a8913c8a7e63c76c4f550dac2f2503d4f92d20be160397128a76c",+ "request_bytes": 8736,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 779.4187499999978,+ "connect_ms": 473.12083299999586+ },+ {+ "call_order": 61,+ "phase": "measured",+ "pair_index": 26,+ "case_id": "IG002_b_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "3990f5b3f78a8913c8a7e63c76c4f550dac2f2503d4f92d20be160397128a76c",+ "request_bytes": 8736,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 986.5524579999985,+ "connect_ms": 537.0707500000051+ },+ {+ "call_order": 62,+ "phase": "measured",+ "pair_index": 27,+ "case_id": "IG024_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "91f7a678c95265704758e7b8fd7cb9c58148029e6f3174c2ac812ffb0a45f25d",+ "request_bytes": 11500,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 991.3492910000059,+ "connect_ms": 525.7990829999954+ },+ {+ "call_order": 63,+ "phase": "measured",+ "pair_index": 27,+ "case_id": "IG024_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "91f7a678c95265704758e7b8fd7cb9c58148029e6f3174c2ac812ffb0a45f25d",+ "request_bytes": 11500,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 811.9516670000024,+ "connect_ms": 488.6380829999979+ },+ {+ "call_order": 64,+ "phase": "measured",+ "pair_index": 28,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "b9c57b346e11d9361d65268658811410c20909e2c4969787f879ebc4a66636e7",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 817.4041249999959,+ "connect_ms": 445.19941699999777+ },+ {+ "call_order": 65,+ "phase": "measured",+ "pair_index": 28,+ "case_id": "IG004_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "b9c57b346e11d9361d65268658811410c20909e2c4969787f879ebc4a66636e7",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1151.6757910000024,+ "connect_ms": 639.6957909999941+ },+ {+ "call_order": 66,+ "phase": "measured",+ "pair_index": 29,+ "case_id": "IG026_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "a639c1efefe12748ce92b52d70321021009f6a77c09229aec1b8892daa7e49e7",+ "request_bytes": 12585,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 926.5405420000121,+ "connect_ms": 432.4424170000043+ },+ {+ "call_order": 67,+ "phase": "measured",+ "pair_index": 29,+ "case_id": "IG026_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "a639c1efefe12748ce92b52d70321021009f6a77c09229aec1b8892daa7e49e7",+ "request_bytes": 12585,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1114.0705830000002,+ "connect_ms": 629.123000000007+ },+ {+ "call_order": 68,+ "phase": "measured",+ "pair_index": 30,+ "case_id": "IG023_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "cbb3bb49386b9432b1d6021a2ab51414b6c32a4c4c3bdb2a3fee076269a2ac51",+ "request_bytes": 8644,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 965.2561669999926,+ "connect_ms": 521.810957999989+ },+ {+ "call_order": 69,+ "phase": "measured",+ "pair_index": 30,+ "case_id": "IG023_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "cbb3bb49386b9432b1d6021a2ab51414b6c32a4c4c3bdb2a3fee076269a2ac51",+ "request_bytes": 8644,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 915.7789589999936,+ "connect_ms": 527.8129589999878+ },+ {+ "call_order": 70,+ "phase": "measured",+ "pair_index": 31,+ "case_id": "IG023_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "da5ca2c0d683820778db9f9ccb08ee9d71dca99a08346631bac52c63dca1cb47",+ "request_bytes": 11301,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1011.9605409999934,+ "connect_ms": 484.39887499999656+ },+ {+ "call_order": 71,+ "phase": "measured",+ "pair_index": 31,+ "case_id": "IG023_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "da5ca2c0d683820778db9f9ccb08ee9d71dca99a08346631bac52c63dca1cb47",+ "request_bytes": 11301,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 906.7943339999971,+ "connect_ms": 506.2765840000054+ },+ {+ "call_order": 72,+ "phase": "measured",+ "pair_index": 32,+ "case_id": "IG010_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "350be8e1932e9201236fbaa83aa7bc6f7d599353501f2edc65ede6849ac8b42e",+ "request_bytes": 8686,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 986.4035419999908,+ "connect_ms": 473.12487499999634+ },+ {+ "call_order": 73,+ "phase": "measured",+ "pair_index": 32,+ "case_id": "IG010_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "350be8e1932e9201236fbaa83aa7bc6f7d599353501f2edc65ede6849ac8b42e",+ "request_bytes": 8686,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 968.1606670000065,+ "connect_ms": 604.9505419999974+ },+ {+ "call_order": 74,+ "phase": "measured",+ "pair_index": 33,+ "case_id": "IG018_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "05727a584c412456b43947484f3e8998de6fb7223617306223c46f54e821756e",+ "request_bytes": 8796,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 785.2411249999989,+ "connect_ms": 439.58308300000226+ },+ {+ "call_order": 75,+ "phase": "measured",+ "pair_index": 33,+ "case_id": "IG018_b_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "05727a584c412456b43947484f3e8998de6fb7223617306223c46f54e821756e",+ "request_bytes": 8796,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1201.46195800001,+ "connect_ms": 739.0428750000098+ },+ {+ "call_order": 76,+ "phase": "measured",+ "pair_index": 34,+ "case_id": "IG026_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "8b24e8092bd457001f268bdb279ef4b1e411fee8bbb992cd3470d64c9bda739c",+ "request_bytes": 9928,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 833.3457920000029,+ "connect_ms": 467.86720800000126+ },+ {+ "call_order": 77,+ "phase": "measured",+ "pair_index": 34,+ "case_id": "IG026_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "8b24e8092bd457001f268bdb279ef4b1e411fee8bbb992cd3470d64c9bda739c",+ "request_bytes": 9928,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1110.9189999999955,+ "connect_ms": 649.3375829999906+ },+ {+ "call_order": 78,+ "phase": "measured",+ "pair_index": 35,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "e8bf9ca368a8ebf5f1052ddb6279dcc529d1cdba1b3e91d1ca066445d5d440bb",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 794.3012079999932,+ "connect_ms": 446.68699999999717+ },+ {+ "call_order": 79,+ "phase": "measured",+ "pair_index": 35,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "e8bf9ca368a8ebf5f1052ddb6279dcc529d1cdba1b3e91d1ca066445d5d440bb",+ "request_bytes": 8469,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 958.6864999999989,+ "connect_ms": 523.5094999999887+ },+ {+ "call_order": 80,+ "phase": "measured",+ "pair_index": 36,+ "case_id": "IG024_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "3bec6f09b85091d81f060ac83a4536557d2aa66cf07f2d8871d5ca2abda02499",+ "request_bytes": 8843,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 903.9863750000023,+ "connect_ms": 471.72849999999755+ },+ {+ "call_order": 81,+ "phase": "measured",+ "pair_index": 36,+ "case_id": "IG024_a_en",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "3bec6f09b85091d81f060ac83a4536557d2aa66cf07f2d8871d5ca2abda02499",+ "request_bytes": 8843,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 815.8273330000014,+ "connect_ms": 476.165457999997+ },+ {+ "call_order": 82,+ "phase": "measured",+ "pair_index": 37,+ "case_id": "IG010_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "c0bab99c1398767987c887260d2219a79e956bdb80bf000584069b6776f7e88d",+ "request_bytes": 11343,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 994.1236250000003,+ "connect_ms": 515.4379589999962+ },+ {+ "call_order": 83,+ "phase": "measured",+ "pair_index": 37,+ "case_id": "IG010_a_zh",+ "backend": "jev113",+ "model": "typesafe/jev-1.13-20260917",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "c0bab99c1398767987c887260d2219a79e956bdb80bf000584069b6776f7e88d",+ "request_bytes": 11343,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 868.214542000004,+ "connect_ms": 425.8865840000112+ },+ {+ "call_order": 84,+ "phase": "measured",+ "pair_index": 38,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "no_application_proxy",+ "body_sha256": "011118f4d5f66f4134e59e36e9b80848706819e361d89397b55cd2b39c4bf38f",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 813.578457999995,+ "connect_ms": 437.5823329999946+ },+ {+ "call_order": 85,+ "phase": "measured",+ "pair_index": 38,+ "case_id": "IG004_a_en",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "direct",+ "route": "explicit_proxy",+ "body_sha256": "011118f4d5f66f4134e59e36e9b80848706819e361d89397b55cd2b39c4bf38f",+ "request_bytes": 11126,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1052.6123750000097,+ "connect_ms": 587.9222920000018+ },+ {+ "call_order": 86,+ "phase": "measured",+ "pair_index": 39,+ "case_id": "IG010_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "explicit_proxy",+ "body_sha256": "7c1a6bc52b9216fc972215ef59c522fcd315d66689b7f9c626a82e4f1615f34e",+ "request_bytes": 8686,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1049.4405839999956,+ "connect_ms": 510.3002089999933+ },+ {+ "call_order": 87,+ "phase": "measured",+ "pair_index": 39,+ "case_id": "IG010_a_zh",+ "backend": "jev114",+ "model": "typesafe/jev-1.14-20261014",+ "method": "decomposed",+ "route": "no_application_proxy",+ "body_sha256": "7c1a6bc52b9216fc972215ef59c522fcd315d66689b7f9c626a82e4f1615f34e",+ "request_bytes": 8686,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 845.2767090000037,+ "connect_ms": 448.0031249999996+ }+ ]+}diff --git a/experiments/system-one-routing-paper/diagnostics/connection_timing.py b/experiments/system-one-routing-paper/diagnostics/connection_timing.pynew file mode 100644index 00000000..a7893e1d--- /dev/null+++ b/experiments/system-one-routing-paper/diagnostics/connection_timing.py@@ -0,0 +1,146 @@+#!/usr/bin/env python3+"""Reduce saved connection timings offline; no network or model execution."""++import argparse+import json+import math+import statistics+from collections import Counter, defaultdict+from pathlib import Path+++def summarize(data):+ records = data['records']+ expected_cells = {+ (model, method, route)+ for model in data['models']+ for method in ('direct', 'decomposed')+ for route in ('explicit_proxy', 'no_application_proxy')+ }+ cells = defaultdict(list)+ pairs = defaultdict(list)+ warmups = Counter()+ for call_order, row in enumerate(records):+ key = row['backend'], row['method'], row['route']+ if key not in expected_cells or row['call_order'] != call_order:+ raise ValueError('Unexpected cell or call order')+ if row['model'] != data['models'][row['backend']]:+ raise ValueError('Unexpected model identity')+ if row['http_status'] != 200 or row['valid_answer'] is not True:+ raise ValueError('Invalid response must not be silently excluded')+ if not all(math.isfinite(row[k]) and row[k] >= 0+ for k in ('elapsed_ms', 'connect_ms')):+ raise ValueError('Invalid duration')+ if row['elapsed_ms'] < row['connect_ms']:+ raise ValueError('Connection exceeds elapsed time')+ if row['phase'] == 'warmup':+ warmups[key] += 1+ elif row['phase'] == 'measured':+ cells[key].append(row)+ pairs[row['pair_index']].append(row)+ else:+ raise ValueError('Unknown phase')+ if len(records) != 88 or set(cells) != expected_cells:+ raise ValueError('Incomplete record population')+ if warmups != Counter({key: 1 for key in expected_cells}):+ raise ValueError('Expected one excluded warmup per cell')+ if set(pairs) != set(range(40)):+ raise ValueError('Incomplete paired population')+ first_paths = Counter()+ for pair in pairs.values():+ if len(pair) != 2 or {r['route'] for r in pair} != {+ 'explicit_proxy', 'no_application_proxy'}:+ raise ValueError('Incomplete route pair')+ if len({(r['case_id'], r['backend'], r['method'], r['body_sha256'])+ for r in pair}) != 1:+ raise ValueError('Paired request bodies differ')+ first_paths[(pair[0]['backend'], pair[0]['method'], pair[0]['route'])] += 1+ if first_paths != Counter({key: 5 for key in expected_cells}):+ raise ValueError('Unbalanced path order')+ summaries = []+ for (backend, method, route), rows in sorted(cells.items()):+ if len(rows) != 10 or {r['case_id'] for r in rows} != set(data['selected_ids']):+ raise ValueError('Inconsistent context sample')+ post = sorted(r['elapsed_ms'] - r['connect_ms'] for r in rows)+ summaries.append({+ 'backend': backend, 'method': method, 'route': route, 'n': len(rows),+ 'median_elapsed_ms': statistics.median(r['elapsed_ms'] for r in rows),+ 'median_connect_ms': statistics.median(r['connect_ms'] for r in rows),+ # Subtract each call's own connection phase before aggregation.+ 'median_post_connection_ms': statistics.median(post),+ 'p95_post_connection_ms': post[math.ceil(.95 * len(post)) - 1],+ })+ return summaries+++def summarize_qwen(data, selected_ids):+ if data['model'] != 'qwen3.8-flash' or data['selected_ids'] != selected_ids:+ raise ValueError('Different model or context sample')+ records = data['records']+ if len(records) != 22:+ raise ValueError('Incomplete Qwen population')+ cells = defaultdict(list)+ warmups = Counter()+ for call_order, row in enumerate(records):+ if row['call_order'] != call_order or row['model'] != data['model']:+ raise ValueError('Unexpected Qwen order or model')+ if row['backend'] != 'qwen38flash' or row['method'] not in ('direct', 'decomposed'):+ raise ValueError('Unexpected Qwen cell')+ if row['http_status'] != 200 or row['valid_answer'] is not True:+ raise ValueError('Invalid Qwen response must not be silently excluded')+ if not all(math.isfinite(row[k]) and row[k] >= 0+ for k in ('elapsed_ms', 'connect_ms')):+ raise ValueError('Invalid Qwen duration')+ if row['connect_ms'] > row['elapsed_ms']:+ raise ValueError('Qwen connection exceeds total duration')+ if row['phase'] == 'warmup':+ warmups[row['method']] += 1+ elif row['phase'] == 'measured':+ cells[row['method']].append(row)+ else:+ raise ValueError('Unknown Qwen phase')+ if warmups != Counter({'direct': 1, 'decomposed': 1}):+ raise ValueError('Expected two excluded Qwen warmups')+ if sum(r['usage_total_tokens'] for r in records) != data['observed_total_tokens']:+ raise ValueError('Qwen token accounting differs')+ summaries = []+ for method in ('direct', 'decomposed'):+ rows = cells[method]+ if len(rows) != 10 or {r['case_id'] for r in rows} != set(selected_ids):+ raise ValueError('Inconsistent Qwen context sample')+ post = sorted(r['elapsed_ms'] - r['connect_ms'] for r in rows)+ summaries.append({+ 'backend': 'qwen38flash', 'method': method, 'route': 'study_transport',+ 'n': len(rows),+ 'median_elapsed_ms': statistics.median(r['elapsed_ms'] for r in rows),+ 'median_connect_ms': statistics.median(r['connect_ms'] for r in rows),+ 'median_post_connection_ms': statistics.median(post),+ 'p95_post_connection_ms': post[math.ceil(.95 * len(post)) - 1],+ })+ return summaries+++def main():+ parser = argparse.ArgumentParser(description=__doc__)+ parser.add_argument('--json', action='store_true', help='Print all recorded timing cells')+ args = parser.parse_args()+ data = json.loads(Path(__file__).with_name('connection-timing.json').read_text())+ rows = summarize(data)+ qwen = json.loads(Path(__file__).with_name('qwen-connection-timing.json').read_text())+ rows += summarize_qwen(qwen, data['selected_ids'])+ if args.json:+ print(json.dumps(rows, indent=2))+ return+ print('| Backend | Format | Median latency | p95 latency |')+ print('|---|---|---:|---:|')+ for backend, name in (('jev113', 'Jev 1.13'), ('jev114', 'Jev 1.14'),+ ('qwen38flash', 'Qwen 3.8 Flash')):+ for method, label in (('direct', 'Direct'), ('decomposed', 'Decomposed')):+ row = next(r for r in rows if r['backend'] == backend and r['method'] == method+ and r['route'] in ('explicit_proxy', 'study_transport'))+ median, p95 = row['median_post_connection_ms'], row['p95_post_connection_ms']+ print(f'| {name} | {label} | {median:,.0f} ms | {p95:,.0f} ms |')+++if __name__ == '__main__':+ main()diff --git a/experiments/system-one-routing-paper/diagnostics/qwen-connection-timing.json b/experiments/system-one-routing-paper/diagnostics/qwen-connection-timing.jsonnew file mode 100644index 00000000..d96ffecd--- /dev/null+++ b/experiments/system-one-routing-paper/diagnostics/qwen-connection-timing.json@@ -0,0 +1,359 @@+{+ "schema": "hiroute.paper.qwen-connection-timing/v1",+ "measurement_date": "2026-10-19",+ "purpose": "Qwen completion of the setup-excluded latency comparison. No decision-quality re-evaluation.",+ "source_results_sha256": "a1a53171e66de47fb4965eddac29c7432e74b98c2e79f58f0b234835b7ab290b",+ "model": "qwen3.8-flash",+ "selected_ids": [+ "IG004_a_en",+ "IG023_a_en",+ "IG002_b_en",+ "IG024_a_en",+ "IG026_a_en",+ "IG004_a_zh",+ "IG021_a_reworded_zh",+ "IG010_a_zh",+ "IG018_b_zh",+ "IG026_b_zh"+ ],+ "seed": 20261019,+ "execution": "One request at a time; fresh SSL context and connection for each; per-call setup and total durations. Two warmups excluded. Exact original frozen request bodies plus the original model parameter; no prompt changes.",+ "timing_definition": {+ "elapsed_ms": "Monotonic time immediately before connection through complete response reading, JSON parsing and connection closure. SSL context creation is before this timer.",+ "connect_ms": "Connection phase: DNS, TCP and TLS.",+ "post_connection_ms": "For each request subtract connect_ms from elapsed_ms, then aggregate."+ },+ "observed_total_tokens": 43972,+ "records": [+ {+ "call_order": 0,+ "phase": "warmup",+ "case_id": "IG004_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "86ab708831de1424b42cb0c3557e6bfb22c79acc21cd622e70d869c6d15301ce",+ "request_bytes": 11056,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 656.416083,+ "connect_ms": 160.10816599999998,+ "usage_total_tokens": 1963+ },+ {+ "call_order": 1,+ "phase": "warmup",+ "case_id": "IG004_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "bdabf5f0d7eeade114a35315518ada59d75660bf65ec0dac3f1e595c89d77cdc",+ "request_bytes": 9903,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 986.36175,+ "connect_ms": 112.30783299999992,+ "usage_total_tokens": 1806+ },+ {+ "call_order": 2,+ "phase": "measured",+ "case_id": "IG024_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "bddbc7366c1f5e8b16d964b9ee58f685321151a50d4e7ed19862e0782b0e7450",+ "request_bytes": 10301,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1012.9105410000001,+ "connect_ms": 107.956583,+ "usage_total_tokens": 1895+ },+ {+ "call_order": 3,+ "phase": "measured",+ "case_id": "IG004_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "bdabf5f0d7eeade114a35315518ada59d75660bf65ec0dac3f1e595c89d77cdc",+ "request_bytes": 9903,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 947.7140419999998,+ "connect_ms": 133.57883300000006,+ "usage_total_tokens": 1806+ },+ {+ "call_order": 4,+ "phase": "measured",+ "case_id": "IG018_b_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "9f5d8f1eca4000e15120c0d1954bc14466290735fd0da87dae33abdc8e8a87c9",+ "request_bytes": 11407,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 553.546291,+ "connect_ms": 162.14195799999987,+ "usage_total_tokens": 2061+ },+ {+ "call_order": 5,+ "phase": "measured",+ "case_id": "IG018_b_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "b32ea3281edb17e340007009f7942b2ebc09aa542adec129f3cdb2e17dc73dff",+ "request_bytes": 10254,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1109.8987920000002,+ "connect_ms": 128.11145899999943,+ "usage_total_tokens": 1904+ },+ {+ "call_order": 6,+ "phase": "measured",+ "case_id": "IG010_a_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "129fc9723f56dfb92bb47fe1248df40d0e4bda0b7e200ff331ca553551237967",+ "request_bytes": 11297,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 460.09520800000024,+ "connect_ms": 122.53995799999996,+ "usage_total_tokens": 2019+ },+ {+ "call_order": 7,+ "phase": "measured",+ "case_id": "IG021_a_reworded_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "fc6b2c145491072c8f13cde12e526d8a8df520ab9caec763d48eed6697f7e989",+ "request_bytes": 11211,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 651.1492910000003,+ "connect_ms": 132.3008750000003,+ "usage_total_tokens": 2011+ },+ {+ "call_order": 8,+ "phase": "measured",+ "case_id": "IG026_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "1e47220f02ba1610bf540ba922aeac9616c45786535b3991b229aa1d81a44a00",+ "request_bytes": 11403,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1641.9355829999995,+ "connect_ms": 111.92912499999963,+ "usage_total_tokens": 2241+ },+ {+ "call_order": 9,+ "phase": "measured",+ "case_id": "IG026_b_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "ebeb9a00349e1fde92e26bf80366916e664c14f310d7297895f4b8df36d7db67",+ "request_bytes": 11310,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1125.7747920000015,+ "connect_ms": 117.92395900000052,+ "usage_total_tokens": 2232+ },+ {+ "call_order": 10,+ "phase": "measured",+ "case_id": "IG023_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "f68e4aba8c78a317214012a0bb2b8216809eb75dade9ce21c32943f42709598b",+ "request_bytes": 11247,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 863.114834000001,+ "connect_ms": 153.30816700000048,+ "usage_total_tokens": 2000+ },+ {+ "call_order": 11,+ "phase": "measured",+ "case_id": "IG002_b_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "1f04fd47f4cf1e1e965cbbae8b3537ad9a276d88e96b514c0bda32a268a2360a",+ "request_bytes": 10194,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1641.6495829999994,+ "connect_ms": 145.63595799999973,+ "usage_total_tokens": 1880+ },+ {+ "call_order": 12,+ "phase": "measured",+ "case_id": "IG004_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "86ab708831de1424b42cb0c3557e6bfb22c79acc21cd622e70d869c6d15301ce",+ "request_bytes": 11056,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 587.9213330000006,+ "connect_ms": 120.79441700000082,+ "usage_total_tokens": 1963+ },+ {+ "call_order": 13,+ "phase": "measured",+ "case_id": "IG004_a_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "6a1c3f970f9e0c04cbe09b6af308abe7c59c99d59071a47af25d7fbece27819d",+ "request_bytes": 9863,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1011.3808749999986,+ "connect_ms": 128.9896249999991,+ "usage_total_tokens": 1801+ },+ {+ "call_order": 14,+ "phase": "measured",+ "case_id": "IG021_a_reworded_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "d9ef5eff0dee5eb4c5b170f61b5b693918c2775b9da7e3e6a5487d1e12694236",+ "request_bytes": 10058,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1355.068082999999,+ "connect_ms": 136.67412499999898,+ "usage_total_tokens": 1849+ },+ {+ "call_order": 15,+ "phase": "measured",+ "case_id": "IG002_b_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "95f90d8440883301ee41ce0f7972a44deacd276fe48a7fe589a48f41025f7a01",+ "request_bytes": 11347,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 630.4219580000013,+ "connect_ms": 164.95904200000132,+ "usage_total_tokens": 2037+ },+ {+ "call_order": 16,+ "phase": "measured",+ "case_id": "IG026_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "6fd240e27087b59db074de8f0d24064bbb6efc6b8a9e1a97e27f8d56e0aaf4cd",+ "request_bytes": 12556,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 556.7652499999998,+ "connect_ms": 112.45133400000107,+ "usage_total_tokens": 2398+ },+ {+ "call_order": 17,+ "phase": "measured",+ "case_id": "IG010_a_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "6137c2122735595559983178ffb1a5403fa8a91b61f86d3a82f874237f818565",+ "request_bytes": 10144,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1148.7141660000013,+ "connect_ms": 147.45412499999944,+ "usage_total_tokens": 1862+ },+ {+ "call_order": 18,+ "phase": "measured",+ "case_id": "IG024_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "72765f17accc41b420aa82b91047a7ceb5624425a25707b215894a8ac4e5840c",+ "request_bytes": 11454,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 502.35804200000086,+ "connect_ms": 120.41341700000174,+ "usage_total_tokens": 2053+ },+ {+ "call_order": 19,+ "phase": "measured",+ "case_id": "IG023_a_en",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "decomposed",+ "body_sha256": "dd24fa88923258ac0e8b241f9c8e1b34fd8d8dd0743acb908dbc4b5896cb699e",+ "request_bytes": 10094,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 1047.5334170000003,+ "connect_ms": 125.22841700000242,+ "usage_total_tokens": 1843+ },+ {+ "call_order": 20,+ "phase": "measured",+ "case_id": "IG004_a_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "d6a778274f031dd528e6413b668462bebaf61ce95ab208d73eef1795f32240db",+ "request_bytes": 11016,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 723.1200829999977,+ "connect_ms": 145.00291699999934,+ "usage_total_tokens": 1958+ },+ {+ "call_order": 21,+ "phase": "measured",+ "case_id": "IG026_b_zh",+ "backend": "qwen38flash",+ "model": "qwen3.8-flash",+ "method": "direct",+ "body_sha256": "1662664944bcaa93412032a6fe3c32d9f644aba502605491823ee59223da6d91",+ "request_bytes": 12463,+ "http_status": 200,+ "valid_answer": true,+ "elapsed_ms": 772.7191249999983,+ "connect_ms": 108.8993330000001,+ "usage_total_tokens": 2390+ }+ ]+}diff --git a/experiments/system-one-routing-paper/main.md b/experiments/system-one-routing-paper/main.mdindex 1dd4333c..65178ac8 100644--- a/experiments/system-one-routing-paper/main.md+++ b/experiments/system-one-routing-paper/main.md@@ -337,18 +337,18 @@ In these observed workloads, three-question routing costs about **USD 0.084–0.These amounts cover decision calls only, not executor work, dataset construction or review. Qwen runs on a subscription Token Plan and is reported in tokens; we do not derive a comparable per-request USD cost from that allowance or claim a measured dollar saving relative to Qwen. The evaluated backend identities and versions are disclosed, but this public draft does not name the hosted Jev access service, which limits exact reproduction of billing and transport conditions.-### Client-observed latency and scalar consistency+### Client-observed latency excluding connection setup (n=10 per cell)-| Backend | Format | Median client latency | p95 client latency |+| Backend | Format | Median latency | p95 latency ||---|---|---:|---:|-| Jev 1.13 | Direct | 948 ms | 1,030 ms |-| Jev 1.13 | Decomposed | 911 ms | 1,040 ms |-| Jev 1.14 | Direct | 935 ms | 1,040 ms |-| Jev 1.14 | Decomposed | 899 ms | 1,077 ms |-| Qwen 3.8 Flash | Direct | 740 ms | 1,654 ms |-| Qwen 3.8 Flash | Decomposed | 1,328 ms | 1,769 ms |--This descriptive post-run table includes all 128 inputs and two repeats per cell, and p95 uses the nearest-rank definition. Jev was reached through a hosted decision API over a proxy, while Qwen used its Token Plan endpoint, so absolute differences include transport, scheduling and service effects. The sample does not show that System One is universally faster; Qwen direct has the lowest median in this campaign. The three native questions do not require serial round trips.+| Jev 1.13 | Direct | 504 ms | 595 ms |+| Jev 1.13 | Decomposed | 468 ms | 533 ms |+| Jev 1.14 | Direct | 489 ms | 637 ms |+| Jev 1.14 | Decomposed | 468 ms | 571 ms |+| Qwen 3.8 Flash | Direct | 466 ms | 710 ms |+| Qwen 3.8 Flash | Decomposed | 992 ms | 1,530 ms |++### Scalar consistencyNative Jev historical scalars differ by at most 0.01 from the expectations reconstructed from the displayed probabilities. Qwen's generated scalar differs by more than 0.05 in seven of 256 decomposed responses, by up to 0.7. In a post-run sensitivity check, replacing only the scalar with that expectation would change three Qwen actions in the determinate main panel, each from correct enhanced-tier protection to an incorrect standard-tier selection. The reported main results keep the supplied scalars, with no arithmetic repair, modal-grade substitution or threshold calibration. This is why generated numerical reports and native decision outputs need separate consistency checks.