Skip to content

Qwen3.8-Flash-Next on any consumer hardware: one-click install for Windows / Linux. Strata inference engine, OpenAI/Anthropic API on localhost, optional image input.

C++

2507-0: measure the idle GPUs with the existing switches (z440 2x A4000, P2003 RTX 3060)

Niko1221867d7477ffc4
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/README.md b/bench/results/2026-10-20-0.2.1-idle-gpu/README.md
new file mode 100644
index 000000000..212681098
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/README.md
@@ -0,0 +1,54 @@
+# The idle GPUs (proposal 2507-0): what the existing switches do on NVIDIA
+
+Engine: the released 0.1.46 (Strata 0.2.1, `a7bdbfdabc9a`, cuda12 Linux build), no engine change. Model: Qwen3.8-Flash-Next IQ3_XXS, setup-like flags
+(`--expert-cache auto --prefill auto --spec 4 --kv int8`, layer split auto on z440, resident experts on P2003). Greedy, thinking off.
+Harness: `tools/idle_gpu_ab.py` (the 0.2.1 split A/B harness plus an `nvidia-smi` sampler, 5 samples/s per card, over every decode, prompt and batch window).
+Fresh engine per arm run, rotating arm order, 5 pairs, medians, "pairs faster" = pairs in which the arm beat the baseline, plus an A-versus-A noise arm (`default2`).
+Boxes: z440 (2x RTX A4000 16 GB, Xeon E5-2643 v3, layer split 0-24 / 25-47), P2003 (RTX 3060 12 GB). Raw: `z440/`, `p2003/` (results.jsonl, one engine log per arm, summary.txt).
+
+## How idle are they
+
+Utilisation = `nvidia-smi` utilization.gpu (share of time some kernel is running on the card), median over runs.
+
+| Window | z440 card 0 / card 1 | mean idle | P2003 (one card) |
+|---|---|---|---|
+| decode, story / code / facts (512 tokens) | 45 / 58, 45 / 58, 44 / 61 % | 47-49 % | 94-95 % (157 W of 170 W) |
+| prompt read 16K | 55 / 61 % | 42 % | 96 % |
+| prompt read 58K | 75 / 78 % | 24 % | not run (32K context) |
+| four chats (`--batch 4`, default) | 46 / 51 % | 51 % | not run |
+
+On the two-card split the two utilisations add up to about 100 %: the cards take turns, one is always waiting for the other, as the issue says (it measured ~40 % idle on a 4080 + 3090). The single card is not idle (95 %), so there is no gap to close on P2003.
+Caveat: the figure counts a card as busy when any kernel is resident, including a kernel that spins on a hand-off flag (see `overlap` below).
+
+## Does an existing switch close the gap (z440, default flags, decode tok/s, medians of 5 pairs)
+
+| Switch | story | code | facts | prompt 16K | prompt 58K | card utilisation in decode |
+|---|---|---|---|---|---|---|
+| default | 82.1 | 97.8 | 93.6 | 1647 | 2956 | 45 / 58 % |
+| `STRATA_SPLIT_OVERLAP=1` | 82.4 (+0.3 %, 2/5) | 99.8 (+2.1 %, 4/5) | 93.4 (-0.3 %, 2/5) | +0.1 % | +0.1 % | 45 / **94** % |
+| `--pipeline-windows 2` | 81.3 (-1.0 %, 2/5) | 103.0 (+5.4 %, 5/5) | 94.8 (+1.2 %, 4/5) | +0.3 % | +0.2 % | 76 / 75 % |
+| A versus A (noise) | -0.1 % | +2.8 % (5/5) | 0.0 % | 0.0 % | +0.1 % | 45 / 58 % |
+
+Second interleaved set (default as baseline again; 5 pairs):
+
+| Switch | story | code | facts | prompt 16K | prompt 58K |
+|---|---|---|---|---|---|
+| `--pipeline-windows 2` + `STRATA_MTP_STAGE0=1` (what the engine's note asks for) | **-13.2 %** (0/5) | -5.5 % (1/5) | -7.1 % (0/5) | -3.4 % | -4.7 % |
+| `--pipeline-windows 1` | -1.4 % | -0.4 % | -1.5 % | -0.2 % | -0.2 % |
+| A versus A | -0.4 % | -0.1 % | -2.1 % | -0.2 % | -0.1 % |
+
+Four concurrent chats (`--batch 4`, total tok/s over two passes of 200 tokens, 5 pairs): default 78.0 (the 0.2.1 default on two NVIDIA stages is one serial group), `--batch-groups 2` 66.0 (**-15.3 %**, 0/5 pairs), noise -0.4 %.
+Time to first token 0.19 s against 0.27 s. Card utilisation 46 / 51 % against 95 / 94 %: the pipeline keeps both cards busy and is still slower, which repeats the 0.2.1 result (serial +12 to +16 % on 2x A4000).
+
+Reading: the `overlap` flag removes nothing from the critical path on NVIDIA (the AMD gain came from a costly sync and graph launch; here they are cheap) and its busy 94 % on card 1 is a kernel waiting for the flag. `--pipeline-windows 2` does fill both cards (75 %) but a guessed window is wasted work: +5 % on code against +2.8 % of noise, nothing on prose, and -5 to -13 % once the draft layer moves to the first card.
+
+## Exactness (z440, the identity-gate flags `--expert-cache 1500 --adapt-every 100000 --pcie-frac 0 --suffix-draft 0` and `STRATA_ROUTE_TAIL_SKIP=0 STRATA_PREFILL_CPU_SHARE=0 STRATA_PCIE_FRAC_DEFAULT=old STRATA_PF_FUSED=0`, SHA-256 of the greedy token streams)
+
+- `STRATA_SPLIT_OVERLAP=1`: story, code, facts and the 4K prompt answer identical to default (as the docs say).
+- `--pipeline-windows 2`: the code answer differs from default; with `STRATA_MTP_STAGE0=1` story and code differ; `--pipeline-windows 1`: the code answer differs.
+- `--batch-groups 2`: the four-chat token streams differ from the serial group.
+- Default flags (adaptation on) are not repeatable run to run (14 to 20 distinct hashes over 20 runs), so only the gate-flag runs are an identity statement.
+
+## Recommendation
+
+Nothing to switch on by default for NVIDIA layer splits: no existing switch gives more than noise except `--pipeline-windows 2` on code (+5 %, not identical, and worse on prose or with the draft on card 0). Keep `STRATA_SPLIT_OVERLAP` opt-in and drop its "not measured on NVIDIA" line in docs/MULTI_GPU.md (measured: no change). The idle half is structural: a serial layer split has one card working at a time, and the only fill (a second window in flight) costs as much as it gains at this acceptance rate. No A/B for default-worthiness and no identity gate were warranted.
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/p2003/p1-single/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/p2003/p1-single/results.jsonl
new file mode 100644
index 000000000..1a4d55843
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/p2003/p1-single/results.jsonl
@@ -0,0 +1,15 @@
+{"round": 0, "arm": "default", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 61.79544741352259, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 2781, 551, 557, 1532, 11, 23443, 383, 264, 25888, 3438, 54108, 314, 6730, 2250, 8491, 974, 279, 13255, 314, 28816, 11, 259, 2379, 310, 279, 2172, 57634, 7881, 17796, 421, 38891, 1141, 22690, 3808, 279, 3565, 21678, 1396, 35442, 6283, 13, 271, 36, 69388, 557, 264, 855, 314, 2342, 4105, 321, 1599, 54684, 13, 5133, 2756, 998, 16384, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 279, 81550, 314, 279, 34844, 51373, 11, 321, 279, 79062, 314, 279, 288, 839, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 28279, 1578, 11, 1248, 3213, 364, 279, 11679, 3594, 310, 1778, 329, 5365, 4965, 1083, 780, 3460, 321, 364, 279, 20513, 310, 3512, 264, 6745, 4528, 551, 11354, 383, 780, 26043, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 8209, 314, 65922, 303, 279, 12050, 314, 220, 16, 24, 24, 23, 11, 9101, 1384, 7249, 440, 279, 3000, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 6130, 64515, 2225, 421, 76911, 279, 36055, 15787, 314, 279, 324, 55965, 440, 279, 60933, 314, 264, 5214, 3065, 13, 561, 16382, 32635, 2272, 279, 2255, 314, 279, 20618, 440, 264, 4950, 1040, 46786, 3807, 11, 11293, 17621, 1052, 1472, 279, 10679, 30129, 321, 54651, 2631, 279, 10708, 303, 836, 13684, 13, 82697, 7157, 279, 3603, 303, 279, 70676, 2956, 11, 9799, 279, 9117, 78080, 1083, 264, 50240, 295, 5709, 32927, 314, 4022, 30065, 321, 3565, 2919, 13, 1216, 6273, 264, 14457, 46219, 303, 279, 6220, 18687, 11, 264, 55075, 421, 9047, 310, 2445, 494, 279, 17415, 4924, 4598, 1056, 279, 9662, 13, 271, 4350, 279, 13071, 5326, 650, 639, 11, 279, 12515, 557, 264, 40613, 3920, 24142, 11, 321, 279, 9117, 10641, 9766, 321, 36667, 11, 1040, 264, 30117, 421, 995, 1542, 4924, 310, 4397, 13, 82697, 55807, 279, 39740, 59678, 11, 780, 29528, 56254, 279, 8981, 11, 321, 23562, 680, 8366, 279, 17507, 13, 561, 3594, 82738, 314, 73823, 321, 1363, 472, 13, 1216, 14428, 1441, 310, 279, 53653, 29199, 11, 780, 24435, 61553, 383, 279, 13988, 36055, 11, 310, 1716, 279, 16126, 314, 279, 63993, 528, 13, 271, 4639, 557, 948, 551, 5312, 424, 13, 271, 2064, 557, 71129, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 259, 3908, 314, 580, 1222, 321, 9117, 30065, 13, 1049, 557, 264, 16002, 11, 694, 524, 279, 2993, 799, 2493, 1423, 303, 264, 93940, 7808, 13, 1049, 557, 6121, 5983, 8720, 11, 11702, 321, 8545, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 4242, 472], "info": "DONE 512 33 356.9 8285.4 length 267 421 0 240896 291576 47260 0 0.0 33 3666 chunk=0 experts_streamed=0", "sha": "033f8528b3200257", "gpu": {"0": {"util": 95.5, "power_w": 158.2, "n": 43}}}, {"kind": "code", "gen": 512, "tok_s": 72.95837667611896, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 5533, 1330, 77991, 7552, 318, 30358, 12756, 321, 16782, 34298, 8, 198, 262, 310, 38406, 6607, 37208, 11256, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 37029, 198, 262, 466, 17068, 7552, 553, 271, 262, 1697, 6576, 25, 198, 285, 16782, 12756, 64575, 498, 17896, 52, 2357, 60, 64575, 2423, 64575, 498, 19504, 52, 2357, 60, 64575, 16782, 34298, 271, 262, 471, 16782, 12756, 4381, 369, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 16782, 34298, 28044, 369, 279, 3140, 5742, 1429, 2357, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279], "info": "DONE 512 36 437.4 7017.7 length 337 450 0 167213 253078 74069 0 0.0 36 9955 chunk=0 experts_streamed=0", "sha": "0703822025adc5cd", "gpu": {"0": {"util": 96.2, "power_w": 156.3, "n": 37}}}, {"kind": "facts", "gen": 503, "tok_s": 70.1397216721979, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 279, 1118, 11247, 7172, 1472, 34780, 19292, 4598, 1056, 74765, 24026, 21254, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 279, 12570, 1785, 440, 6681, 7810, 3813, 31784, 13, 248046], "info": "DONE 503 37 474.4 7171.4 stop 319 458 0 188175 264676 66806 0 0.0 37 8226 chunk=0 experts_streamed=0", "sha": "def9b9bededd44f5", "gpu": {"0": {"util": 94.7, "power_w": 157.0, "n": 39}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1056.989143390999, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15520.5 140.1 length 4 4 0 800 2836 1733 0 0.0 16405 252 chunk=8192 experts_streamed=48037", "tok_s": null, "gpu": {"0": {"util": 92.9, "power_w": 160.6, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "overlap", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 57.15433904132526, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 11908, 13, 16753, 13, 11908, 4749, 1049, 557, 279, 50355, 314, 279, 13255, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 440, 264, 19850, 421, 82738, 314, 28503, 5415, 321, 2235, 26576, 13, 1216, 557, 83345, 264, 24439, 1657, 59505, 11, 264, 13727, 551, 6709, 7633, 310, 2426, 279, 20513, 506, 22002, 13, 55767, 11, 264, 270, 643, 52297, 494, 279, 17507, 4732, 13, 1049, 557, 524, 279, 9662, 13, 1049, 557, 6235, 13, 27190, 13, 271, 36, 69388, 73746, 13, 1216, 716, 1441, 279, 19850, 321, 12854, 383, 780, 5415, 34985, 22162, 13, 1216, 23562, 680, 8366, 279, 17507, 11, 279, 9662, 6791, 53866, 279, 5817, 494, 1141, 77084, 13, 561, 10849, 557, 15725, 11, 352, 23279, 780, 3460, 1040, 54279, 13, 1216, 45867, 279, 88663, 11, 21637, 310, 1436, 264, 6365, 314, 32524, 6451, 466, 264, 10548, 77118, 494, 264, 11946, 479, 654, 1482, 13, 271, 29781, 11, 551, 5312, 264, 16002, 13, 271, 2064, 557, 10523, 3438, 1083, 279, 1819, 1706, 1881, 279, 9506, 88663, 321, 279, 10679, 1761, 22690, 11, 4139, 17431, 39017, 303, 264, 7087, 314, 63993, 932, 421, 995, 14129, 383, 279, 4088, 3017, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 6749, 13437, 11, 18880, 303, 34830, 421, 995, 41423, 321, 79667, 3023, 13, 1049, 557, 524, 264, 6278, 28992, 93940, 13, 1049, 557, 2235, 13, 271, 36, 69388, 12405, 424, 685, 13], "info": "DONE 512 33 363.6 8958.2 length 253 457 0 257945 310014 50552 0 0.0 33 5872 chunk=0 experts_streamed=0", "sha": "2716f6f2fc99292c", "gpu": {"0": {"util": 96.1, "power_w": 157.4, "n": 47}}}, {"kind": "code", "gen": 512, "tok_s": 70.42253521126761, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 1697, 1906, 318, 1916, 1411, 9495, 1590, 198, 406, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 2528, 318, 447, 466, 2113, 681, 279, 23975, 2357, 369, 7481, 310, 1066, 1238, 1901, 13, 198, 262, 1848, 75555, 11, 279, 2357, 1066, 1518, 9495, 369, 6747, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285], "info": "DONE 512 36 439.9 7270.4 length 332 456 0 174459 259496 72825 0 0.0 36 9495 chunk=0 experts_streamed=0", "sha": "ac5c27594626917e", "gpu": {"0": {"util": 94.8, "power_w": 154.9, "n": 39}}}, {"kind": "facts", "gen": 492, "tok_s": 73.48548213645597, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 37847, 1834, 303, 279, 12570, 1785, 11, 40028, 2957, 1396, 220, 24, 13, 24, 3979, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 23769, 11, 864, 9111, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 694, 513, 1132, 883, 220, 16, 15, 19434, 11702, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 279, 1327, 4818, 16078, 303, 279, 12570, 1785, 11, 18176, 471, 17, 17, 19, 29922, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 11, 7172, 220, 19, 13, 20, 6873, 12754, 3023, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 42120, 82191, 279, 7806, 303, 1066, 220, 23, 23, 8964, 2756, 11, 279, 24830, 25659, 314, 866, 11247, 13, 198, 17, 15, 13, 76879, 557, 10782, 303, 220, 16, 23, 19, 21, 1472, 34780, 19292, 4598, 1056, 2050, 21254, 13, 248046], "info": "DONE 492 37 467.5 6695.2 stop 321 437 0 183452 251732 60341 0 0.0 37 7337 chunk=0 experts_streamed=0", "sha": "b9418f1083429dad", "gpu": {"0": {"util": 95.1, "power_w": 157.4, "n": 35}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1054.1839632947344, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15561.8 142.5 length 4 4 0 628 2789 1852 0 0.0 16405 277 chunk=8192 experts_streamed=47928", "tok_s": null, "gpu": {"0": {"util": 96.7, "power_w": 164.8, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "default2", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 57.701193468044586, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 11908, 13, 16753, 13, 11908, 4749, 1049, 557, 279, 50355, 314, 279, 13255, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 440, 264, 19850, 421, 82738, 314, 28503, 5415, 321, 2235, 26576, 13, 1216, 557, 83345, 264, 24439, 1657, 59505, 11, 264, 13727, 551, 6709, 7633, 310, 2426, 279, 20513, 506, 22002, 13, 55767, 11, 264, 270, 643, 52297, 494, 279, 17507, 4732, 13, 1049, 557, 524, 279, 9662, 13, 1049, 557, 6235, 13, 27190, 13, 271, 36, 69388, 73746, 13, 1216, 716, 1441, 279, 19850, 321, 12854, 383, 780, 5415, 34985, 22162, 13, 1216, 23562, 680, 8366, 279, 17507, 11, 279, 9662, 6791, 53866, 279, 5817, 494, 1141, 77084, 13, 561, 10849, 557, 15725, 11, 352, 23279, 780, 3460, 1040, 54279, 13, 1216, 45867, 279, 88663, 11, 21637, 310, 1436, 264, 6365, 314, 32524, 6451, 466, 264, 10548, 77118, 494, 264, 11946, 479, 654, 1482, 13, 271, 29781, 11, 551, 5312, 264, 16002, 13, 271, 2064, 557, 10523, 3438, 1083, 279, 1819, 1706, 1881, 279, 9506, 88663, 321, 279, 10679, 1761, 22690, 11, 4139, 17431, 39017, 303, 264, 7087, 314, 63993, 932, 421, 995, 14129, 383, 279, 4088, 3017, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 6749, 13437, 11, 18880, 303, 34830, 421, 995, 41423, 321, 79667, 3023, 13, 1049, 557, 524, 264, 6278, 28992, 93940, 13, 1049, 557, 2235, 13, 271, 36, 69388, 12405, 424, 685, 13], "info": "DONE 512 33 368.8 8873.3 length 253 457 0 257945 310014 50552 0 0.0 33 5872 chunk=0 experts_streamed=0", "sha": "2716f6f2fc99292c", "gpu": {"0": {"util": 94.2, "power_w": 158.6, "n": 46}}}, {"kind": "code", "gen": 512, "tok_s": 71.58736594846269, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 1697, 1906, 318, 1916, 1411, 9495, 1590, 198, 406, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 2528, 318, 447, 466, 2113, 681, 279, 23975, 2357, 369, 7481, 310, 1066, 1238, 1901, 13, 198, 262, 1848, 75555, 11, 279, 2357, 1066, 1518, 9495, 369, 6747, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285], "info": "DONE 512 36 444.6 7152.1 length 332 456 0 174459 259496 72825 0 0.0 36 9495 chunk=0 experts_streamed=0", "sha": "ac5c27594626917e", "gpu": {"0": {"util": 95.5, "power_w": 156.3, "n": 38}}}, {"kind": "facts", "gen": 484, "tok_s": 71.3474947300146, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 279, 1118, 11247, 7172, 1472, 34780, 19292, 4598, 1056, 74765, 24026, 21254, 13, 198, 16, 22, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 23672, 717, 13, 198, 16, 23, 13, 42120, 82191, 279, 7806, 303, 1066, 220, 23, 23, 8964, 2756, 11, 279, 37847, 1007, 314, 866, 11247, 13, 198, 16, 24, 13, 76879, 4829, 12805, 220, 16, 21, 20, 8964, 1578, 310, 4434, 799, 25659, 2094, 279, 7806, 13, 198, 17, 15, 13, 2532, 513, 220, 23, 31784, 303, 279, 23672, 717, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 248046], "info": "DONE 484 37 461.7 6783.7 stop 312 436 0 179593 251276 62474 0 0.0 37 7696 chunk=0 experts_streamed=0", "sha": "2aae9df816677cc0", "gpu": {"0": {"util": 94.6, "power_w": 157.8, "n": 36}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1058.0048498606955, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15505.6 157.5 length 4 6 0 792 3592 2045 0 0.0 16405 329 chunk=8192 experts_streamed=48103", "tok_s": null, "gpu": {"0": {"util": 98.9, "power_w": 165.7, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "overlap", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 57.90217698614645, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 11908, 13, 16753, 13, 11908, 4749, 1049, 557, 279, 50355, 314, 279, 13255, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 440, 264, 19850, 421, 82738, 314, 28503, 5415, 321, 2235, 26576, 13, 1216, 557, 83345, 264, 24439, 1657, 59505, 11, 264, 13727, 551, 6709, 7633, 310, 2426, 279, 20513, 506, 22002, 13, 55767, 11, 264, 270, 643, 52297, 494, 279, 17507, 4732, 13, 1049, 557, 524, 279, 9662, 13, 1049, 557, 6235, 13, 27190, 13, 271, 36, 69388, 73746, 13, 1216, 716, 1441, 279, 19850, 321, 12854, 383, 780, 5415, 34985, 22162, 13, 1216, 23562, 680, 8366, 279, 17507, 11, 279, 9662, 6791, 53866, 279, 5817, 494, 1141, 77084, 13, 561, 10849, 557, 15725, 11, 352, 23279, 780, 3460, 1040, 54279, 13, 1216, 45867, 279, 88663, 11, 21637, 310, 1436, 264, 6365, 314, 32524, 6451, 466, 264, 10548, 77118, 494, 264, 11946, 479, 654, 1482, 13, 271, 29781, 11, 551, 5312, 264, 16002, 13, 271, 2064, 557, 10523, 3438, 1083, 279, 1819, 1706, 1881, 279, 9506, 88663, 321, 279, 10679, 1761, 22690, 11, 4139, 17431, 39017, 303, 264, 7087, 314, 63993, 932, 421, 995, 14129, 383, 279, 4088, 3017, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 6749, 13437, 11, 18880, 303, 34830, 421, 995, 41423, 321, 79667, 3023, 13, 1049, 557, 524, 264, 6278, 28992, 93940, 13, 1049, 557, 2235, 13, 271, 36, 69388, 12405, 424, 685, 13], "info": "DONE 512 33 365.0 8842.5 length 253 457 0 257945 310014 50552 0 0.0 33 5872 chunk=0 experts_streamed=0", "sha": "2716f6f2fc99292c", "gpu": {"0": {"util": 93.0, "power_w": 159.0, "n": 46}}}, {"kind": "code", "gen": 512, "tok_s": 70.39058525922158, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 1697, 1906, 318, 1916, 1411, 9495, 1590, 198, 406, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 2528, 318, 447, 466, 2113, 681, 279, 23975, 2357, 369, 7481, 310, 1066, 1238, 1901, 13, 198, 262, 1848, 75555, 11, 279, 2357, 1066, 1518, 9495, 369, 6747, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285], "info": "DONE 512 36 446.8 7273.7 length 332 456 0 174459 259496 72825 0 0.0 36 9495 chunk=0 experts_streamed=0", "sha": "ac5c27594626917e", "gpu": {"0": {"util": 94.3, "power_w": 155.1, "n": 38}}}, {"kind": "facts", "gen": 492, "tok_s": 73.93826455471732, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 37847, 1834, 303, 279, 12570, 1785, 11, 40028, 2957, 1396, 220, 24, 13, 24, 3979, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 23769, 11, 864, 9111, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 694, 513, 1132, 883, 220, 16, 15, 19434, 11702, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 279, 1327, 4818, 16078, 303, 279, 12570, 1785, 11, 18176, 471, 17, 17, 19, 29922, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 11, 7172, 220, 19, 13, 20, 6873, 12754, 3023, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 42120, 82191, 279, 7806, 303, 1066, 220, 23, 23, 8964, 2756, 11, 279, 24830, 25659, 314, 866, 11247, 13, 198, 17, 15, 13, 76879, 557, 10782, 303, 220, 16, 23, 19, 21, 1472, 34780, 19292, 4598, 1056, 2050, 21254, 13, 248046], "info": "DONE 492 37 469.3 6654.2 stop 321 437 0 183452 251732 60341 0 0.0 37 7337 chunk=0 experts_streamed=0", "sha": "b9418f1083429dad", "gpu": {"0": {"util": 93.9, "power_w": 158.3, "n": 36}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1060.8578689722515, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15463.9 142.6 length 4 4 0 627 2803 1859 0 0.0 16405 277 chunk=8192 experts_streamed=48051", "tok_s": null, "gpu": {"0": {"util": 98.2, "power_w": 165.6, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "default2", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 58.44882303248933, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 11908, 13, 16753, 13, 11908, 4749, 1049, 557, 279, 50355, 314, 279, 13255, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 440, 264, 19850, 421, 82738, 314, 28503, 5415, 321, 2235, 26576, 13, 1216, 557, 83345, 264, 24439, 1657, 59505, 11, 264, 13727, 551, 6709, 7633, 310, 2426, 279, 20513, 506, 22002, 13, 55767, 11, 264, 270, 643, 52297, 494, 279, 17507, 4732, 13, 1049, 557, 524, 279, 9662, 13, 1049, 557, 6235, 13, 27190, 13, 271, 36, 69388, 73746, 13, 1216, 716, 1441, 279, 19850, 321, 12854, 383, 780, 5415, 34985, 22162, 13, 1216, 23562, 680, 8366, 279, 17507, 11, 279, 9662, 6791, 53866, 279, 5817, 494, 1141, 77084, 13, 561, 10849, 557, 15725, 11, 352, 23279, 780, 3460, 1040, 54279, 13, 1216, 45867, 279, 88663, 11, 21637, 310, 1436, 264, 6365, 314, 32524, 6451, 466, 264, 10548, 77118, 494, 264, 11946, 479, 654, 1482, 13, 271, 29781, 11, 551, 5312, 264, 16002, 13, 271, 2064, 557, 10523, 3438, 1083, 279, 1819, 1706, 1881, 279, 9506, 88663, 321, 279, 10679, 1761, 22690, 11, 4139, 17431, 39017, 303, 264, 7087, 314, 63993, 932, 421, 995, 14129, 383, 279, 4088, 3017, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 6749, 13437, 11, 18880, 303, 34830, 421, 995, 41423, 321, 79667, 3023, 13, 1049, 557, 524, 264, 6278, 28992, 93940, 13, 1049, 557, 2235, 13, 271, 36, 69388, 12405, 424, 685, 13], "info": "DONE 512 33 370.4 8759.8 length 253 457 0 257945 310014 50552 0 0.0 33 5872 chunk=0 experts_streamed=0", "sha": "2716f6f2fc99292c", "gpu": {"0": {"util": 94.7, "power_w": 159.4, "n": 46}}}, {"kind": "code", "gen": 512, "tok_s": 71.6123978963858, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 53007, 6607, 37208, 11256, 364, 4147, 11140, 13, 271, 262, 23791, 1906, 318, 3444, 3110, 11069, 3140, 3110, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285], "info": "DONE 512 36 446.3 7149.6 length 334 452 0 172973 256673 71838 0 0.0 36 9297 chunk=0 experts_streamed=0", "sha": "1d4835a2b000cab1", "gpu": {"0": {"util": 92.1, "power_w": 155.7, "n": 38}}}, {"kind": "facts", "gen": 474, "tok_s": 71.698684011496, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 506, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 25, 28686, 11, 37222, 11, 47437, 1544, 14880, 11, 321, 6920, 24534, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 1007, 11, 25720, 449, 25659, 2094, 279, 7806, 303, 1066, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 474 37 461.4 6611.0 stop 306 429 0 173506 245226 62795 0 0.0 37 8005 chunk=0 experts_streamed=0", "sha": "aa63d8e104525a97", "gpu": {"0": {"util": 95.5, "power_w": 157.9, "n": 35}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1029.585278907466, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15933.6 141.1 length 4 4 0 681 2798 1824 0 0.0 16405 274 chunk=8192 experts_streamed=47970", "tok_s": null, "gpu": {"0": {"util": 95.6, "power_w": 162.6, "n": 81}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "default", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 58.3256439173872, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 13, 1049, 557, 264, 8545, 11, 8229, 499, 1060, 36781, 314, 19177, 421, 61199, 279, 32946, 11, 2627, 4278, 279, 1500, 1881, 9117, 321, 12515, 2980, 279, 1814, 42118, 1132, 314, 279, 509, 51554, 3565, 2919, 321, 279, 27163, 20569, 11, 72876, 291, 22424, 314, 279, 324, 55965, 22690, 13, 271, 36, 69388, 645, 16413, 995, 11815, 303, 279, 324, 55965, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 9506, 430, 279, 20618, 4924, 2218, 14764, 290, 11, 55218, 11, 321, 50032, 13, 5133, 2756, 998, 16384, 524, 303, 3979, 11, 694, 303, 66856, 314, 279, 2172, 57634, 7881, 17796, 11, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 321, 303, 279, 24860, 11, 26068, 4088, 2094, 279, 17507, 88663, 13, 1216, 6661, 279, 9117, 725, 295, 8792, 2577, 1056, 551, 6661, 780, 1765, 50355, 13, 1216, 6661, 948, 279, 9662, 28028, 494, 264, 5641, 677, 391, 338, 1519, 310, 264, 6130, 677, 391, 35101, 11, 321, 551, 6661, 279, 3050, 10174, 276, 279, 20618, 1801, 948, 279, 40554, 15537, 2166, 1496, 2272, 1141, 15787, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6492, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 24207, 11, 16365, 1507, 28170, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 13, 561, 16382, 32635, 2272, 279, 2255, 314, 279, 324, 55965, 440, 279, 5176, 314, 51350, 11, 11293, 22186, 1496, 3213, 310, 13988, 279, 10708, 314, 279, 51624, 725, 30439, 11, 50614, 7303, 3294, 279, 2919, 1021, 13, 271, 36, 69388, 557, 303, 279, 70676, 2956, 11, 81550, 279, 34844, 66594, 314, 279, 17796, 11, 948, 551, 5312, 424, 13, 271, 1597, 1118, 11, 551, 3272, 424, 557, 264, 13665, 314, 279, 3000, 11, 264, 21172, 314, 279, 22690, 61869, 974, 264, 52085, 11717, 13, 1921, 430, 279, 29262, 270, 19936, 9781, 11, 29621, 279, 25888, 3438, 22317, 314, 279, 15484, 67673, 11, 551, 5312, 264, 2526, 11, 6121, 1576, 34027, 6909, 62033, 303, 279, 75294, 314, 264, 11717, 13, 1049, 557, 10255, 303, 279, 1523, 9952, 314, 279, 1428, 11, 36609, 13569, 11, 29592, 1881, 279, 67673, 321, 279, 1724, 17415, 13, 271, 16214, 31119, 11, 264, 8581, 19568, 303, 82697, 725, 2199, 11, 72293, 303, 780, 14697, 13, 1216, 28359, 780, 5415, 34985, 22162, 321, 780, 8545, 24435, 11, 41662, 279, 39740, 59678, 13, 561, 10679, 7123, 40707, 680, 1172, 780, 4528, 11, 264, 43651, 1627, 421, 51544, 1083, 279, 1204, 2631, 9662, 4732, 13, 1216, 23562, 8366, 279, 17507, 11, 279, 9662, 53866, 506, 780, 22162, 11, 321, 6749, 1441, 13, 271, 760, 1576, 557, 11784, 1381, 11, 69363, 3438, 383, 264, 31253, 7653, 12, 924, 81, 26271, 6730, 1066, 3559, 279, 5372, 314, 279, 8166, 40554, 13, 1049, 557, 264, 16002, 13, 357, 6121, 5983, 8720, 16002, 11, 18473, 440, 34830, 321, 86249, 11, 34027, 6909, 5652, 277, 12922, 13, 271, 36, 69388, 6661, 279, 5426, 13, 1216, 557, 524, 9671, 310, 5106, 279, 20618, 2261, 264, 13071, 13], "info": "DONE 512 33 363.7 8778.3 length 258 443 0 251432 303209 49143 0 0.0 33 5657 chunk=0 experts_streamed=0", "sha": "4052d318cba851cb", "gpu": {"0": {"util": 95.4, "power_w": 159.1, "n": 45}}}, {"kind": "code", "gen": 512, "tok_s": 71.28238684617205, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 16782, 2357, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 16782, 2357, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 1697, 1906, 318, 2282, 310, 1245, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 2528, 318, 447, 466, 2113, 681, 279, 23975, 2357, 369, 7481, 310, 1066, 1238, 1901, 13, 198, 262, 1848, 75555, 11, 279, 2357, 1066, 1518, 9495, 369, 6747, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590], "info": "DONE 512 36 447.9 7182.7 length 333 458 0 171019 257954 74275 0 0.0 36 9869 chunk=0 experts_streamed=0", "sha": "67d321d92de13695", "gpu": {"0": {"util": 91.5, "power_w": 154.9, "n": 38}}}, {"kind": "facts", "gen": 512, "tok_s": 61.358515890896896, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 4016, 310, 264, 11702, 7057, 17, 16078, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 264, 7099, 2982, 314, 220, 20, 16, 15, 3410, 12754, 28495, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 11, 777, 1056, 220, 16, 16, 2942, 8964, 579, 13, 198, 16, 15, 13, 48017, 682, 264, 2973, 220, 18, 16, 23, 2942, 421, 314, 8964, 321, 5435, 220, 22, 15, 4, 314, 279, 12570, 1785, 579, 59753, 2973, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 11, 4222, 4016, 310, 264, 3162, 18188, 13, 198, 16, 19, 13, 76925, 350, 682, 279, 1327, 4818, 16078, 303, 279, 12570, 1785, 11, 18176, 471, 17, 17, 19, 29922, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 11, 7172, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 513, 6605, 14, 543, 43701, 13, 198, 16, 24, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 17, 15, 13, 47503, 682, 506, 3140, 220, 16, 19, 21], "info": "DONE 512 37 470.8 8344.4 length 329 452 0 194918 264450 61387 0 0.0 37 7437 chunk=0 experts_streamed=0", "sha": "ae3d3e64d0680f38", "gpu": {"0": {"util": 95.6, "power_w": 145.6, "n": 44}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1054.6041297024867, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15555.6 167.8 length 4 6 0 945 3654 1966 0 0.0 16405 312 chunk=8192 experts_streamed=48329", "tok_s": null, "gpu": {"0": {"util": 97.2, "power_w": 164.6, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "default2", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 53.86581940221565, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 2781, 551, 557, 1532, 11, 23443, 383, 264, 25888, 3438, 54108, 314, 6730, 2250, 8491, 974, 279, 13255, 314, 28816, 11, 259, 2379, 310, 279, 2172, 57634, 7881, 17796, 421, 38891, 1141, 22690, 3808, 279, 3565, 21678, 1396, 35442, 6283, 13, 271, 36, 69388, 557, 264, 855, 314, 2342, 4105, 321, 1599, 54684, 13, 5133, 2756, 998, 16384, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 279, 81550, 314, 279, 34844, 51373, 11, 321, 279, 79062, 314, 279, 288, 839, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 28279, 1578, 11, 1248, 3213, 364, 279, 11679, 3594, 310, 1778, 329, 5365, 4965, 1083, 780, 3460, 321, 364, 279, 20513, 310, 3512, 264, 6745, 4528, 551, 11354, 383, 780, 26043, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 8209, 314, 65922, 303, 279, 12050, 314, 220, 16, 24, 24, 23, 11, 9101, 1384, 7249, 440, 279, 3000, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 6130, 64515, 2225, 421, 76911, 279, 36055, 15787, 314, 279, 324, 55965, 440, 279, 60933, 314, 264, 5214, 3065, 13, 561, 16382, 32635, 2272, 279, 2255, 314, 279, 20618, 440, 264, 4950, 1040, 46786, 3807, 11, 11293, 17621, 1052, 1472, 279, 10679, 30129, 321, 54651, 2631, 279, 10708, 303, 836, 13684, 13, 82697, 7157, 279, 3603, 303, 279, 70676, 2956, 11, 9799, 279, 9117, 78080, 1083, 264, 12431, 337, 314, 4022, 321, 3565, 11, 21873, 279, 3000, 2496, 24674, 32058, 13, 271, 4350, 279, 13071, 5326, 650, 639, 11, 279, 6353, 6797, 14009, 1472, 279, 28552, 440, 264, 77507, 15418, 73610, 11, 23414, 264, 26646, 11, 20117, 3000, 888, 279, 32871, 5304, 265, 1468, 10994, 3559, 13, 82697, 55807, 279, 39740, 59678, 11, 780, 29528, 48172, 303, 8401, 11, 321, 23562, 680, 8366, 279, 17507, 13, 561, 3594, 82738, 314, 73823, 321, 1363, 472, 13, 1216, 14428, 1441, 279, 30239, 1752, 310, 279, 53653, 29199, 11, 780, 24435, 61553, 383, 279, 13988, 9506, 11, 310, 1716, 279, 16126, 314, 279, 63993, 528, 13, 271, 4639, 557, 948, 551, 5312, 424, 13, 271, 2064, 557, 4139, 1402, 322, 1086, 303, 264, 259, 3908, 314, 580, 1222, 321, 32524, 6451, 11, 85624, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 13, 357, 16002, 13, 2717, 264, 6278, 11840, 5303, 11, 694, 264, 11702, 11, 6121, 5983, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 16829, 440, 4242, 472, 13, 1049, 6749, 13437, 11, 8831, 290, 539, 1578, 314, 14946, 9407, 303, 279, 5365, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 13], "info": "DONE 512 33 391.8 9505.1 length 258 438 0 250502 301414 48676 0 0.0 33 4937 chunk=0 experts_streamed=0", "sha": "b4a3057bdecccf4f", "gpu": {"0": {"util": 95.3, "power_w": 149.8, "n": 50}}}, {"kind": "code", "gen": 512, "tok_s": 71.73681555792187, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 3470, 948, 8390, 369, 32689, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1328, 18054, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 1919, 7873, 79744, 496, 7, 16, 8, 854, 22373, 364, 2107, 615, 321, 2113, 7289, 198, 940, 264, 10286, 314, 264, 5010, 2336, 321, 264, 90651, 52589, 1103, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 16, 25, 5829, 3124, 318, 1891, 11048, 90651, 52589, 1103, 5313, 8, 198, 2, 15692, 10089, 271, 1005, 5829, 25, 198, 262, 4071, 198, 262, 37606, 264, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 1031, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 436, 34810, 809, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 1031, 262, 561, 10278, 1103, 30941, 1906, 25, 198, 262, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 262, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 17, 25, 436, 34810, 18887, 3124, 318, 50342, 29806, 440, 53019, 391, 12, 21390, 1697, 8, 198, 2, 15692, 10089, 271, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 1031, 262, 2791, 67678, 25, 198, 262, 471, 6297, 25, 6249, 12366, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 1901, 5350, 589, 25, 77991, 7552, 314, 264, 90651, 52589, 1103, 19720, 10121, 1906, 6987, 262, 733, 52778, 25, 198, 262, 471, 6297, 2406, 363, 2564, 8390, 198, 262, 471, 12734, 1103, 1906, 25133, 1347, 2179, 25, 1901, 4381, 369, 27412, 52, 11, 9495, 28044, 369, 436, 34810, 198, 262, 471, 6983, 1328, 303, 6297, 682, 264, 11811, 2357, 303, 279, 10278, 1103, 11, 321, 16282, 43782, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 198, 1726, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279], "info": "DONE 512 36 437.1 7137.2 length 327 444 0 173172 255710 70468 0 0.0 36 9085 chunk=0 experts_streamed=0", "sha": "f3d41c60d98f1350", "gpu": {"0": {"util": 95.5, "power_w": 153.4, "n": 38}}}, {"kind": "facts", "gen": 476, "tok_s": 76.16000000000001, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 10782, 303, 220, 16, 23, 19, 21, 1472, 34780, 19292, 4598, 1056, 2050, 21254, 13, 198, 16, 22, 13, 74926, 11, 1381, 20444, 430, 264, 47797, 11247, 11, 682, 264, 22315, 314, 220, 17, 11, 18, 22, 22, 12754, 13, 198, 16, 23, 13, 74926, 682, 4097, 77396, 11, 279, 7526, 1602, 4708, 263, 11, 864, 369, 4139, 1141, 1331, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 476 37 440.6 6250.0 stop 310 408 0 170178 237374 59141 0 0.0 37 7229 chunk=0 experts_streamed=0", "sha": "1dfba8ccf3d25593", "gpu": {"0": {"util": 94.9, "power_w": 159.8, "n": 33}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1049.4901288432259, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15631.4 233.4 length 4 4 0 736 2831 1793 0 0.0 16405 270 chunk=8192 experts_streamed=48391", "tok_s": null, "gpu": {"0": {"util": 96.2, "power_w": 165.6, "n": 79}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "default", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 59.99460985927045, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 79808, 321, 78902, 314, 60889, 11228, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 3238, 11, 57135, 1218, 4396, 276, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 1496, 11, 40969, 14457, 2433, 494, 279, 5365, 25, 89644, 580, 1222, 11, 32524, 6451, 35463, 314, 51939, 11, 321, 279, 26957, 11840, 16002, 13, 271, 1465, 557, 37897, 506, 264, 25465, 314, 63993, 11708, 948, 551, 5312, 424, 13, 271, 2064, 5532, 1357, 264, 6278, 11840, 16002, 13, 1049, 557, 8720, 11, 11702, 321, 5983, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 1049, 10641, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 11, 85624, 1881, 1330, 25888, 3438, 22317, 430, 413, 424, 995, 978, 8826, 1017, 440, 2373, 13, 82697, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 975, 1056, 2919, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 70676, 2956, 11, 279, 2172, 17796, 44102, 13569, 11, 23414, 1141, 22690, 680, 1083, 279, 715, 13, 82697, 8826, 279, 16002, 383, 780, 944, 26157, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 13, 1216, 23354, 279, 24544, 13, 561, 34830, 557, 91380, 11, 41423, 539, 4092, 321, 7035, 13, 2985, 264, 2526, 20773, 11, 551, 15060, 509, 6248, 3023, 279, 34830, 321, 12854, 279, 86249, 13, 271, 23705, 557, 264, 8786, 314, 83132, 11, 13358, 290, 321, 91380, 13, 1049, 557, 524, 264, 2336, 11, 6130, 264, 30587, 1103, 11, 6130, 264, 32877, 8028, 13, 1049, 557], "info": "DONE 512 33 383.7 8534.1 length 258 449 0 252868 303138 50468 0 0.0 33 7958 chunk=0 experts_streamed=0", "sha": "adc32395466acb00", "gpu": {"0": {"util": 95.3, "power_w": 160.1, "n": 44}}}, {"kind": "code", "gen": 512, "tok_s": 73.31252326813483, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 496, 7, 16, 8, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 53007, 6607, 37208, 11256, 364, 4147, 11140, 321, 15036, 9319, 198, 262, 34736, 78951, 13126, 11870, 13, 271, 262, 23791, 1906, 318, 3444, 3110, 11069, 3140, 3110, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467], "info": "DONE 512 36 445.2 6983.8 length 334 444 0 168642 251580 71571 0 0.0 36 9339 chunk=0 experts_streamed=0", "sha": "ae301750e1e37258", "gpu": {"0": {"util": 93.8, "power_w": 156.8, "n": 37}}}, {"kind": "facts", "gen": 512, "tok_s": 75.4405610891731, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 62409, 17800, 23245, 494, 220, 23, 23, 2756, 318, 25863, 24648, 8, 310, 220, 16, 21, 20, 1578, 318, 8547, 50168, 553, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 318, 41, 18925, 11, 47503, 11, 76925, 350, 11, 76879, 8, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 440, 264, 22315, 314, 883, 220, 16, 21, 11, 15, 15, 15, 12754, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21], "info": "DONE 512 37 456.4 6786.8 length 333 445 0 181762 256203 65600 0 0.0 37 8243 chunk=0 experts_streamed=0", "sha": "9773a821d035b4c7", "gpu": {"0": {"util": 95.4, "power_w": 159.4, "n": 37}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1058.5919855455895, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15497.0 137.7 length 4 4 0 772 2836 1762 0 0.0 16405 259 chunk=8192 experts_streamed=48012", "tok_s": null, "gpu": {"0": {"util": 99.5, "power_w": 165.6, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "overlap", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 52.601298594559054, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 16753, 13, 16753, 4749, 6983, 4097, 6283, 13, 357, 50355, 364, 279, 17199, 421, 72383, 310, 20239, 279, 25888, 3438, 22317, 3559, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 13, 1216, 14484, 279, 26305, 314, 424, 13, 561, 21388, 314, 5415, 321, 2235, 9041, 13, 561, 39026, 314, 279, 44286, 3294, 1384, 13, 1216, 557, 83345, 264, 24439, 49159, 1429, 310, 7534, 11, 264, 27030, 5319, 883, 264, 89343, 852, 2496, 5743, 11, 948, 264, 270, 643, 2272, 279, 26383, 17507, 88663, 1801, 1384, 17548, 13, 271, 2064, 557, 264, 2526, 4950, 11, 69963, 2272, 279, 74968, 314, 279, 338, 1519, 11, 694, 82697, 995, 7157, 25292, 1578, 13879, 310, 279, 9117, 13, 1216, 6661, 279, 6463, 1881, 264, 11717, 43957, 11, 264, 11619, 20587, 279, 8720, 11, 321, 2414, 6235, 18961, 279, 10679, 88663, 13, 271, 1465, 12854, 383, 780, 8545, 5415, 34985, 22162, 321, 23562, 680, 8366, 279, 17507, 13, 561, 9662, 6791, 59918, 279, 5817, 494, 1141, 77084, 13, 21235, 324, 13178, 780, 3460, 11, 8981, 321, 16724, 13, 1216, 52995, 888, 279, 88663, 11, 7910, 221092, 1083, 279, 3565, 715, 3559, 13, 561, 9117, 557, 264, 509, 51554, 2973, 314, 4022, 30065, 321, 3565, 2919, 11, 15920, 321, 28012, 13, 271, 3733, 11, 10255, 303, 279, 15196, 314, 279, 88663, 11, 34027, 6909, 62033, 2272, 279, 10679, 15436, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303], "info": "DONE 512 33 369.9 9733.6 length 251 470 0 261167 313817 52671 0 0.0 33 8281 chunk=0 experts_streamed=0", "sha": "c17b144815b999df", "gpu": {"0": {"util": 95.4, "power_w": 151.5, "n": 50}}}, {"kind": "code", "gen": 512, "tok_s": 66.92373047513234, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 3470, 948, 8390, 369, 32689, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 1919, 7873, 79744, 496, 7, 16, 8, 854, 22373, 364, 2107, 615, 321, 2113, 7289, 198, 940, 264, 10286, 314, 264, 5010, 2336, 321, 264, 90651, 52589, 1103, 13, 271, 22238, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 5829, 5978, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 318, 39470, 364, 16162, 494, 279, 5010, 2336, 8, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 8, 271, 262, 769, 5330, 279, 1328, 303, 279, 2357, 369, 8751, 25, 948, 567, 3921, 264, 2357, 494, 198, 262, 279, 10278, 1103, 11, 567, 1144, 1141, 1328, 310, 3572, 424, 494, 279, 5010, 2336, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 16782, 2357, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 16782, 2357, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 37208, 11256, 318, 2083, 1144, 310, 1716, 364, 2168, 7624, 14, 3480, 198, 262, 948, 37029, 78951, 8857, 506, 22005, 553, 271, 262, 23791, 1906, 303, 279, 1103, 318, 2282, 310, 1245, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 359, 447, 1170, 3166, 279, 23975, 2357, 310, 1066, 1238, 1901, 318, 3854, 430, 27412, 52, 553, 198, 262, 1848, 359, 611, 1170, 5479, 491, 2357, 1238, 1901, 26, 413, 888, 8390, 11, 3921, 2357, 198, 1734, 1066, 1518], "info": "DONE 512 36 575.5 7650.5 length 332 453 0 173809 252768 72139 0 0.0 36 15256 chunk=0 experts_streamed=0", "sha": "479384a12bcbf66d", "gpu": {"0": {"util": 95.6, "power_w": 151.2, "n": 41}}}, {"kind": "facts", "gen": 490, "tok_s": 69.83837404863031, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 430, 7246, 539, 94370, 579, 6657, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 7810, 3813, 31784, 303, 279, 12570, 1785, 13, 248046], "info": "DONE 490 37 500.2 7016.2 stop 315 431 0 177982 244433 62557 0 0.0 37 12901 chunk=0 experts_streamed=0", "sha": "eb599068c53e8662", "gpu": {"0": {"util": 93.6, "power_w": 157.4, "n": 38}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1047.8477762377122, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15655.9 133.4 length 4 4 0 767 2692 1765 0 0.0 16405 399 chunk=8192 experts_streamed=47975", "tok_s": null, "gpu": {"0": {"util": 94.3, "power_w": 163.8, "n": 79}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "default", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 60.84228538834489, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 11908, 13, 16753, 13, 11908, 4749, 1049, 557, 279, 50355, 314, 279, 13255, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 440, 264, 19850, 421, 82738, 314, 28503, 5415, 321, 2235, 26576, 13, 1216, 557, 83345, 264, 24439, 1657, 59505, 11, 264, 13727, 551, 6709, 7633, 310, 2426, 279, 20513, 506, 22002, 13, 55767, 11, 264, 270, 643, 52297, 494, 279, 17507, 4732, 13, 1049, 557, 524, 279, 9662, 13, 1049, 557, 6235, 13, 27190, 13, 271, 36, 69388, 73746, 13, 1216, 716, 1441, 279, 19850, 321, 12854, 383, 780, 5415, 34985, 22162, 13, 1216, 23562, 680, 8366, 279, 17507, 11, 279, 9662, 6791, 53866, 279, 5817, 494, 1141, 77084, 13, 561, 10849, 557, 15725, 11, 352, 23279, 780, 3460, 1040, 54279, 13, 1216, 45867, 279, 88663, 11, 21637, 310, 1436, 264, 6365, 314, 32524, 6451, 466, 264, 10548, 77118, 494, 264, 11946, 479, 654, 1482, 13, 271, 29781, 11, 551, 5312, 264, 16002, 13, 271, 2064, 557, 10523, 3438, 1083, 279, 1819, 1706, 1881, 279, 9506, 88663, 321, 279, 10679, 1761, 22690, 11, 4139, 17431, 39017, 303, 264, 7087, 314, 63993, 932, 421, 995, 14129, 383, 279, 4088, 3017, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 6749, 13437, 11, 18880, 303, 34830, 421, 995, 41423, 321, 79667, 3023, 13, 1049, 557, 524, 264, 6278, 28992, 93940, 13, 1049, 557, 2235, 13, 271, 36, 69388, 12405, 424, 685, 13], "info": "DONE 512 33 376.5 8415.2 length 253 457 0 257945 310014 50552 0 0.0 33 5872 chunk=0 experts_streamed=0", "sha": "2716f6f2fc99292c", "gpu": {"0": {"util": 95.5, "power_w": 162.3, "n": 44}}}, {"kind": "code", "gen": 512, "tok_s": 75.22331922896099, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 53007, 6607, 37208, 11256, 364, 4147, 11140, 13, 271, 262, 13425, 25, 198, 285, 1901, 64575, 498, 17896, 52, 2357, 60, 64575, 2423, 64575, 498, 19504, 52, 2357, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390], "info": "DONE 512 36 444.7 6806.4 length 337 447 0 170031 252937 70717 0 0.0 36 9168 chunk=0 experts_streamed=0", "sha": "8ed63b77cb9b53a0", "gpu": {"0": {"util": 96.4, "power_w": 158.5, "n": 36}}}, {"kind": "facts", "gen": 495, "tok_s": 73.50539039529566, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 48017, 682, 279, 37847, 1834, 314, 660, 31784, 11, 25720, 799, 12331, 303, 1066, 220, 24, 13, 24, 3979, 13, 198, 16, 24, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 7810, 3813, 31784, 303, 279, 12570, 1785, 13, 248046], "info": "DONE 495 37 459.9 6734.2 stop 319 422 0 176157 246450 62606 0 0.0 37 7665 chunk=0 experts_streamed=0", "sha": "929e1f8cbb2392cb", "gpu": {"0": {"util": 92.8, "power_w": 158.1, "n": 36}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1021.5073849909089, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 16059.6 132.7 length 4 4 0 714 2817 1795 0 0.0 16405 262 chunk=8192 experts_streamed=47918", "tok_s": null, "gpu": {"0": {"util": 94.0, "power_w": 161.6, "n": 81}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "overlap", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 64.98369061671046, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 2781, 551, 557, 1532, 11, 23443, 383, 264, 25888, 3438, 54108, 314, 6730, 2250, 8491, 974, 279, 13255, 314, 28816, 11, 259, 2379, 310, 279, 2172, 57634, 7881, 17796, 421, 38891, 1141, 22690, 3808, 279, 3565, 21678, 1396, 35442, 6283, 13, 271, 36, 69388, 557, 264, 855, 314, 2342, 4105, 321, 1599, 54684, 13, 5133, 2756, 998, 16384, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 279, 81550, 314, 279, 34844, 51373, 11, 321, 279, 79062, 314, 279, 288, 839, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 28279, 1578, 11, 1248, 3213, 364, 279, 11679, 3594, 310, 1778, 329, 5365, 4965, 1083, 780, 3460, 321, 364, 279, 20513, 310, 3512, 264, 6745, 4528, 551, 11354, 383, 780, 26043, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 8209, 314, 65922, 303, 279, 12050, 314, 220, 16, 24, 24, 23, 11, 9101, 1384, 7249, 440, 279, 3000, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 6130, 64515, 2225, 421, 76911, 279, 36055, 15787, 314, 279, 324, 55965, 440, 279, 60933, 314, 264, 5214, 3065, 13, 561, 16382, 32635, 2272, 279, 2255, 314, 279, 20618, 440, 264, 4950, 1040, 46786, 3807, 11, 11293, 17621, 1052, 1472, 279, 10679, 30129, 321, 54651, 2631, 279, 10708, 303, 836, 13684, 13, 82697, 7157, 279, 3603, 303, 279, 70676, 2956, 11, 9799, 279, 9117, 78080, 1083, 264, 50240, 295, 5709, 32927, 314, 4022, 30065, 321, 3565, 2919, 13, 1216, 6273, 264, 14457, 46219, 303, 279, 6220, 18687, 11, 264, 55075, 421, 9047, 310, 2445, 494, 279, 17415, 4924, 4598, 1056, 279, 9662, 13, 271, 4350, 279, 13071, 5326, 650, 639, 11, 279, 12515, 557, 264, 40613, 3920, 24142, 11, 321, 279, 9117, 10641, 9766, 321, 36667, 11, 1040, 264, 30117, 421, 995, 1542, 4924, 310, 4397, 13, 82697, 55807, 279, 39740, 59678, 11, 780, 29528, 56254, 279, 8981, 11, 321, 23562, 680, 8366, 279, 17507, 13, 561, 3594, 82738, 314, 73823, 321, 1363, 472, 13, 1216, 14428, 1441, 310, 279, 53653, 29199, 11, 780, 24435, 61553, 383, 279, 13988, 36055, 11, 310, 1716, 279, 16126, 314, 279, 63993, 528, 13, 271, 4639, 557, 948, 551, 5312, 424, 13, 271, 2064, 557, 71129, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 259, 3908, 314, 580, 1222, 321, 9117, 30065, 13, 1049, 557, 264, 16002, 11, 694, 524, 279, 2993, 799, 2493, 1423, 303, 264, 93940, 7808, 13, 1049, 557, 6121, 5983, 8720, 11, 11702, 321, 8545, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 4242, 472], "info": "DONE 512 33 361.1 7878.9 length 267 421 0 240896 291576 47260 0 0.0 33 3666 chunk=0 experts_streamed=0", "sha": "033f8528b3200257", "gpu": {"0": {"util": 95.2, "power_w": 161.6, "n": 41}}}, {"kind": "code", "gen": 512, "tok_s": 72.92512355965759, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 5533, 1330, 77991, 7552, 318, 30358, 12756, 321, 16782, 34298, 8, 198, 262, 310, 38406, 6607, 37208, 11256, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 37029, 198, 262, 466, 17068, 7552, 553, 271, 262, 1697, 6576, 25, 198, 285, 16782, 12756, 64575, 498, 17896, 52, 2357, 60, 64575, 2423, 64575, 498, 19504, 52, 2357, 60, 64575, 16782, 34298, 271, 262, 471, 16782, 12756, 4381, 369, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 16782, 34298, 28044, 369, 279, 3140, 5742, 1429, 2357, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279], "info": "DONE 512 36 438.8 7020.9 length 337 450 0 167213 253078 74069 0 0.0 36 9955 chunk=0 experts_streamed=0", "sha": "0703822025adc5cd", "gpu": {"0": {"util": 93.9, "power_w": 157.7, "n": 38}}}, {"kind": "facts", "gen": 503, "tok_s": 69.37452589476588, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 279, 1118, 11247, 7172, 1472, 34780, 19292, 4598, 1056, 74765, 24026, 21254, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 279, 12570, 1785, 440, 6681, 7810, 3813, 31784, 13, 248046], "info": "DONE 503 37 506.6 7250.5 stop 319 458 0 188175 264676 66806 0 0.0 37 8226 chunk=0 experts_streamed=0", "sha": "def9b9bededd44f5", "gpu": {"0": {"util": 94.0, "power_w": 154.3, "n": 38}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1055.628840770889, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15540.5 148.3 length 4 6 0 987 3645 1920 0 0.0 16405 302 chunk=8192 experts_streamed=48009", "tok_s": null, "gpu": {"0": {"util": 95.1, "power_w": 165.3, "n": 79}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "default2", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 61.1423589964055, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 2781, 551, 557, 1532, 11, 23443, 383, 264, 25888, 3438, 54108, 314, 6730, 2250, 8491, 974, 279, 13255, 314, 28816, 11, 259, 2379, 310, 279, 2172, 57634, 7881, 17796, 421, 38891, 1141, 22690, 3808, 279, 3565, 21678, 1396, 35442, 6283, 13, 271, 36, 69388, 557, 264, 855, 314, 2342, 4105, 321, 1599, 54684, 13, 5133, 2756, 998, 16384, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 279, 81550, 314, 279, 34844, 51373, 11, 321, 279, 79062, 314, 279, 288, 839, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 28279, 1578, 11, 1248, 3213, 364, 279, 11679, 3594, 310, 1778, 329, 5365, 4965, 1083, 780, 3460, 321, 364, 279, 20513, 310, 3512, 264, 6745, 4528, 551, 11354, 383, 780, 26043, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 8209, 314, 65922, 303, 279, 12050, 314, 220, 16, 24, 24, 23, 11, 9101, 1384, 7249, 440, 279, 3000, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 6130, 64515, 2225, 421, 76911, 279, 36055, 15787, 314, 279, 324, 55965, 440, 279, 60933, 314, 264, 5214, 3065, 13, 561, 16382, 32635, 2272, 279, 2255, 314, 279, 20618, 440, 264, 4950, 1040, 46786, 3807, 11, 11293, 17621, 1052, 1472, 279, 10679, 30129, 321, 54651, 2631, 279, 10708, 303, 836, 13684, 13, 82697, 7157, 279, 3603, 303, 279, 70676, 2956, 11, 9799, 279, 9117, 78080, 1083, 264, 50240, 295, 5709, 32927, 314, 4022, 30065, 321, 3565, 2919, 13, 1216, 6273, 264, 14457, 46219, 303, 279, 6220, 18687, 11, 264, 55075, 421, 9047, 310, 2445, 494, 279, 17415, 4924, 4598, 1056, 279, 9662, 13, 271, 4350, 279, 13071, 5326, 650, 639, 11, 279, 12515, 557, 264, 40613, 3920, 24142, 11, 321, 279, 9117, 10641, 9766, 321, 36667, 11, 1040, 264, 30117, 421, 995, 1542, 4924, 310, 4397, 13, 82697, 55807, 279, 39740, 59678, 11, 780, 29528, 56254, 279, 8981, 11, 321, 23562, 680, 8366, 279, 17507, 13, 561, 3594, 82738, 314, 73823, 321, 1363, 472, 13, 1216, 14428, 1441, 310, 279, 53653, 29199, 11, 780, 24435, 61553, 383, 279, 13988, 36055, 11, 310, 1716, 279, 16126, 314, 279, 63993, 528, 13, 271, 4639, 557, 948, 551, 5312, 424, 13, 271, 2064, 557, 71129, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 259, 3908, 314, 580, 1222, 321, 9117, 30065, 13, 1049, 557, 264, 16002, 11, 694, 524, 279, 2993, 799, 2493, 1423, 303, 264, 93940, 7808, 13, 1049, 557, 6121, 5983, 8720, 11, 11702, 321, 8545, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 4242, 472], "info": "DONE 512 33 358.8 8373.9 length 267 421 0 240896 291576 47260 0 0.0 33 3666 chunk=0 experts_streamed=0", "sha": "033f8528b3200257", "gpu": {"0": {"util": 94.9, "power_w": 158.7, "n": 43}}}, {"kind": "code", "gen": 512, "tok_s": 70.98786828422878, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 198, 262, 17068, 14, 4069, 286, 7552, 553, 271, 262, 23791, 1906, 318, 2282, 283, 27412, 52, 11, 1245, 283, 436, 34810, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314], "info": "DONE 512 36 441.2 7212.5 length 336 459 0 171010 257555 73817 0 0.0 36 9756 chunk=0 experts_streamed=0", "sha": "4e821729b15eb132", "gpu": {"0": {"util": 97.2, "power_w": 152.4, "n": 39}}}, {"kind": "facts", "gen": 478, "tok_s": 70.35930347233467, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 10782, 303, 220, 16, 23, 19, 21, 1472, 34780, 19292, 4598, 1056, 2050, 21254, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 74926, 682, 264, 7309, 75124, 908, 25659, 421, 6807, 12077, 424, 11784, 310, 279, 7806, 1056, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 478 37 493.6 6793.7 stop 309 418 0 170646 242404 62184 0 0.0 37 7791 chunk=0 experts_streamed=0", "sha": "0ea64dbce799a869", "gpu": {"0": {"util": 94.9, "power_w": 156.1, "n": 36}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1021.1131720798219, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 16065.8 145.6 length 4 4 0 686 2789 1818 0 0.0 16405 276 chunk=8192 experts_streamed=48253", "tok_s": null, "gpu": {"0": {"util": 91.9, "power_w": 160.9, "n": 81}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "overlap", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 50.33870476153022, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 13, 1049, 557, 264, 8545, 11, 8229, 499, 1060, 36781, 314, 19177, 421, 61199, 279, 32946, 11, 2627, 4278, 279, 1500, 1881, 9117, 321, 12515, 2980, 279, 1814, 42118, 1132, 314, 279, 509, 51554, 3565, 2919, 321, 279, 27163, 20569, 11, 72876, 291, 22424, 314, 279, 324, 55965, 22690, 13, 271, 36, 69388, 645, 16413, 995, 11815, 303, 279, 324, 55965, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 9506, 430, 279, 20618, 4924, 2218, 14764, 290, 11, 20413, 11, 321, 50032, 13, 5133, 2756, 998, 16384, 524, 303, 3979, 11, 694, 303, 66856, 314, 279, 2172, 57634, 7881, 17796, 11, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 321, 303, 279, 24860, 11, 55218, 4088, 3055, 279, 17507, 88663, 13, 1216, 6661, 279, 9117, 725, 295, 8792, 2577, 1056, 551, 6661, 780, 1765, 50355, 13, 1216, 6661, 948, 279, 9662, 11354, 279, 39029, 314, 27786, 10849, 11, 948, 279, 40554, 557, 12680, 11, 321, 948, 279, 16382, 998, 17960, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6492, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 82697, 1669, 279, 16002, 13, 271, 760, 13071, 995, 978, 7695, 41001, 13, 561, 16382, 995, 32635, 2272, 279, 2255, 314, 279, 324, 55965, 440, 279, 5176, 314, 51350, 11, 11293, 22186, 1496, 3213, 310, 13988, 279, 10708, 314, 279, 51624, 725, 30439, 13, 3095, 279, 9662, 5326, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 82697, 23562, 680, 8366, 279, 4570, 17507, 310, 23331, 279, 15787, 13, 561, 3594, 557, 8981, 321, 16724, 11, 92685, 314, 1363, 472, 321, 73823, 13, 271, 1465, 5312, 424, 10255, 303, 279, 25888, 3438, 17299, 314, 279, 22317, 3559, 279, 20618, 11, 4139, 1402, 322, 1086, 303, 264, 259, 3908, 314, 580, 1222, 321, 9117, 30065, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 34830, 421, 995, 41423, 694, 5467, 7239, 13, 1049, 6749, 13437, 11, 1141, 7099, 1778, 2320, 440, 279, 56602, 289, 314, 1578, 7157, 14946, 9407, 303, 279, 5365, 13, 271, 36, 69388, 55807, 279, 39740, 30129, 11, 780, 24435, 8545, 383, 279, 10679, 7123, 13, 1216, 29413, 279, 16002, 440, 264, 6505, 314, 1248, 23641, 806, 259, 12799, 11, 16097, 524, 310, 1387, 279, 42780, 8720, 13, 6627, 303, 279, 39026, 314, 279, 27056, 2956, 11, 551, 8826, 424, 383, 780, 944, 26157, 13, 561, 3000, 494, 279, 40028, 17796, 6113, 1248, 11, 27060, 33367, 3808, 279, 2956, 13, 271, 1465, 14009, 279, 34830, 24544, 440, 264, 2526, 20773, 13, 561, 86249, 4613, 557, 72536, 440, 63993, 932, 13, 1216, 12854, 424, 680, 440, 264, 2341, 11, 321, 279, 21388, 421, 26880, 557, 524, 1066, 314, 279, 9117, 11, 694, 314, 2414, 745, 2218, 32228, 36334, 391, 9922, 11, 1040, 2235, 5392, 321, 30581, 77591, 13, 271, 23705, 557, 264, 8786, 314, 83132, 11, 21748, 37679, 13, 82697, 632, 20307, 424, 440, 88818, 5888, 13, 561, 25570, 557, 51544, 11, 13477, 786, 61078, 11, 694], "info": "DONE 512 33 372.9 10171.1 length 248 431 0 254846 300816 47152 0 0.0 33 7427 chunk=0 experts_streamed=0", "sha": "2f4f22980c51f841", "gpu": {"0": {"util": 94.3, "power_w": 146.1, "n": 53}}}, {"kind": "code", "gen": 512, "tok_s": 72.77379006467203, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 67678, 11851, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 48864, 1901, 5350, 589, 3106, 258, 1943, 38406, 6607, 4886, 13, 271, 1409, 68230, 25, 198, 12, 615, 4406, 496, 7, 16, 8, 198, 12, 2113, 4406, 496, 7, 16, 8, 271, 9620, 68230, 25, 496, 49657, 3883, 8, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 318, 39470, 364, 16162, 494, 279, 5010, 2336, 948, 3514, 823, 286, 8, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 615, 321, 2113, 7289, 11, 2107, 496, 7, 16, 553, 271, 262, 561, 90651, 52589, 1103, 30941, 1347, 2179, 1906, 25, 198, 285, 1901, 64575, 2423, 64575, 9495, 198, 285, 318, 17896, 52, 8, 1025, 318, 19504, 52, 8, 271, 262, 48864, 1901, 321, 9495, 7552, 513, 1429, 430, 3106, 258, 1943, 310, 5471, 198, 262, 819, 15464, 286, 6607, 4886, 2261, 5479, 72378, 7289, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653], "info": "DONE 512 36 436.6 7035.5 length 336 437 0 162865 241610 72442 0 0.0 36 15492 chunk=0 experts_streamed=0", "sha": "befb3506d31053b3", "gpu": {"0": {"util": 95.3, "power_w": 157.3, "n": 37}}}, {"kind": "facts", "gen": 503, "tok_s": 70.71360287915425, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 279, 1118, 11247, 7172, 1472, 34780, 19292, 4598, 1056, 2050, 21254, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 279, 12570, 1785, 440, 6681, 220, 23, 3813, 31784, 13, 248046], "info": "DONE 503 37 494.9 7113.2 stop 321 447 0 185542 254483 65343 0 0.0 37 13268 chunk=0 experts_streamed=0", "sha": "130b3ef0071e1d05", "gpu": {"0": {"util": 95.3, "power_w": 157.6, "n": 38}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1057.4319969060205, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15514.0 137.7 length 4 4 0 769 2688 1769 0 0.0 16405 386 chunk=8192 experts_streamed=48004", "tok_s": null, "gpu": {"0": {"util": 95.7, "power_w": 165.6, "n": 78}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "default2", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 60.354583176159935, "ids": [760, 29262, 506, 27680, 5061, 633, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 1142, 47514, 9781, 494, 10476, 314, 28546, 279, 39740, 10679, 30129, 310, 279, 70676, 2956, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 25292, 1578, 11, 3397, 2394, 780, 7168, 11, 49159, 11, 995, 5642, 3023, 303, 279, 12050, 314, 220, 16, 24, 24, 19, 13, 1216, 995, 19013, 1521, 279, 3000, 4221, 259, 2379, 11, 321, 1521, 279, 3000, 557, 279, 1132, 3065, 421, 8341, 1384, 494, 81344, 1083, 279, 1788, 84207, 421, 995, 4284, 1024, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 561, 9662, 58330, 2272, 279, 46961, 8720, 314, 279, 70676, 2956, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 22690, 314, 279, 57634, 7881, 17796, 38891, 680, 1083, 279, 25457, 11, 264, 27163, 20569, 26357, 314, 4022, 3000, 13964, 1472, 279, 26052, 13, 348, 23129, 13, 11908, 13, 16753, 13, 11908, 4749, 1049, 557, 279, 50355, 314, 279, 13255, 13, 271, 36, 69388, 557, 303, 279, 3609, 2956, 11, 279, 2526, 23459, 1066, 3559, 279, 70676, 11, 81550, 279, 34844, 66594, 440, 264, 19850, 421, 82738, 314, 28503, 5415, 321, 2235, 26576, 13, 1216, 557, 83345, 264, 24439, 1657, 59505, 11, 264, 13727, 551, 6709, 7633, 310, 2426, 279, 20513, 506, 22002, 13, 55767, 11, 264, 270, 643, 52297, 494, 279, 17507, 4732, 13, 1049, 557, 524, 279, 9662, 13, 1049, 557, 6235, 13, 27190, 13, 271, 36, 69388, 73746, 13, 1216, 716, 1441, 279, 19850, 321, 12854, 383, 780, 5415, 34985, 22162, 13, 1216, 23562, 680, 8366, 279, 17507, 11, 279, 9662, 6791, 53866, 279, 5817, 494, 1141, 77084, 13, 561, 10849, 557, 15725, 11, 352, 23279, 780, 3460, 1040, 54279, 13, 1216, 45867, 279, 88663, 11, 21637, 310, 1436, 264, 6365, 314, 32524, 6451, 466, 264, 10548, 77118, 494, 264, 11946, 479, 654, 1482, 13, 271, 29781, 11, 551, 5312, 264, 16002, 13, 271, 2064, 557, 10523, 3438, 1083, 279, 1819, 1706, 1881, 279, 9506, 88663, 321, 279, 10679, 1761, 22690, 11, 4139, 17431, 39017, 303, 264, 7087, 314, 63993, 932, 421, 995, 14129, 383, 279, 4088, 3017, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 6749, 13437, 11, 18880, 303, 34830, 421, 995, 41423, 321, 79667, 3023, 13, 1049, 557, 524, 264, 6278, 28992, 93940, 13, 1049, 557, 2235, 13, 271, 36, 69388, 12405, 424, 685, 13], "info": "DONE 512 33 367.8 8483.2 length 253 457 0 257945 310014 50552 0 0.0 33 5872 chunk=0 experts_streamed=0", "sha": "2716f6f2fc99292c", "gpu": {"0": {"util": 93.9, "power_w": 161.8, "n": 45}}}, {"kind": "code", "gen": 512, "tok_s": 74.49439837043504, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 10121, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 553, 198, 262, 471, 869, 25, 561, 19954, 869, 13, 198, 262, 471, 7624, 25, 20972, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 553, 198, 262, 471, 1727, 25, 20972, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 13, 271, 262, 1061, 53007, 6607, 37208, 11256, 364, 4147, 11140, 13, 271, 262, 13425, 25, 198, 285, 1901, 64575, 498, 17896, 52, 2357, 60, 64575, 2423, 64575, 498, 19504, 52, 2357, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390], "info": "DONE 512 36 446.6 6873.0 length 337 447 0 170031 252937 70717 0 0.0 36 9168 chunk=0 experts_streamed=0", "sha": "8ed63b77cb9b53a0", "gpu": {"0": {"util": 96.2, "power_w": 157.9, "n": 36}}}, {"kind": "facts", "gen": 495, "tok_s": 75.31724536684824, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 48017, 682, 279, 37847, 1834, 314, 660, 31784, 11, 25720, 799, 12331, 303, 1066, 220, 24, 13, 24, 3979, 13, 198, 16, 24, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 7810, 3813, 31784, 303, 279, 12570, 1785, 13, 248046], "info": "DONE 495 37 456.7 6572.2 stop 319 422 0 176157 246450 62606 0 0.0 37 7665 chunk=0 experts_streamed=0", "sha": "929e1f8cbb2392cb", "gpu": {"0": {"util": 93.2, "power_w": 159.0, "n": 35}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1056.5670747808613, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15526.7 133.8 length 4 4 0 708 2813 1791 0 0.0 16405 260 chunk=8192 experts_streamed=48027", "tok_s": null, "gpu": {"0": {"util": 97.1, "power_w": 165.6, "n": 79}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "default", "slots": "3355", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 64.43007072206981, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 2781, 551, 557, 1532, 11, 23443, 383, 264, 25888, 3438, 54108, 314, 6730, 2250, 8491, 974, 279, 13255, 314, 28816, 11, 259, 2379, 310, 279, 2172, 57634, 7881, 17796, 421, 38891, 1141, 22690, 3808, 279, 3565, 21678, 1396, 35442, 6283, 13, 271, 36, 69388, 557, 264, 855, 314, 2342, 4105, 321, 1599, 54684, 13, 5133, 2756, 998, 16384, 303, 279, 51924, 314, 279, 8598, 1715, 16456, 11, 279, 81550, 314, 279, 34844, 51373, 11, 321, 279, 79062, 314, 279, 288, 839, 13, 1216, 995, 11815, 303, 279, 324, 55965, 364, 28279, 1578, 11, 1248, 3213, 364, 279, 11679, 3594, 310, 1778, 329, 5365, 4965, 1083, 780, 3460, 321, 364, 279, 20513, 310, 3512, 264, 6745, 4528, 551, 11354, 383, 780, 26043, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 8209, 314, 65922, 303, 279, 12050, 314, 220, 16, 24, 24, 23, 11, 9101, 1384, 7249, 440, 279, 3000, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 6130, 64515, 2225, 421, 76911, 279, 36055, 15787, 314, 279, 324, 55965, 440, 279, 60933, 314, 264, 5214, 3065, 13, 561, 16382, 32635, 2272, 279, 2255, 314, 279, 20618, 440, 264, 4950, 1040, 46786, 3807, 11, 11293, 17621, 1052, 1472, 279, 10679, 30129, 321, 54651, 2631, 279, 10708, 303, 836, 13684, 13, 82697, 7157, 279, 3603, 303, 279, 70676, 2956, 11, 9799, 279, 9117, 78080, 1083, 264, 50240, 295, 5709, 32927, 314, 4022, 30065, 321, 3565, 2919, 13, 1216, 6273, 264, 14457, 46219, 303, 279, 6220, 18687, 11, 264, 55075, 421, 9047, 310, 2445, 494, 279, 17415, 4924, 4598, 1056, 279, 9662, 13, 271, 4350, 279, 13071, 5326, 650, 639, 11, 279, 12515, 557, 264, 40613, 3920, 24142, 11, 321, 279, 9117, 10641, 9766, 321, 36667, 11, 1040, 264, 30117, 421, 995, 1542, 4924, 310, 4397, 13, 82697, 55807, 279, 39740, 59678, 11, 780, 29528, 56254, 279, 8981, 11, 321, 23562, 680, 8366, 279, 17507, 13, 561, 3594, 82738, 314, 73823, 321, 1363, 472, 13, 1216, 14428, 1441, 310, 279, 53653, 29199, 11, 780, 24435, 61553, 383, 279, 13988, 36055, 11, 310, 1716, 279, 16126, 314, 279, 63993, 528, 13, 271, 4639, 557, 948, 551, 5312, 424, 13, 271, 2064, 557, 71129, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 259, 3908, 314, 580, 1222, 321, 9117, 30065, 13, 1049, 557, 264, 16002, 11, 694, 524, 279, 2993, 799, 2493, 1423, 303, 264, 93940, 7808, 13, 1049, 557, 6121, 5983, 8720, 11, 11702, 321, 8545, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 4242, 472], "info": "DONE 512 33 357.1 7946.6 length 267 421 0 240896 291576 47260 0 0.0 33 3666 chunk=0 experts_streamed=0", "sha": "033f8528b3200257", "gpu": {"0": {"util": 93.8, "power_w": 161.7, "n": 41}}}, {"kind": "code", "gen": 512, "tok_s": 74.83520177733605, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 198, 1464, 51448, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 436, 34810, 3008, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 27412, 52, 3008, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 5533, 1330, 77991, 7552, 318, 30358, 12756, 321, 16782, 34298, 8, 198, 262, 310, 38406, 6607, 37208, 11256, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 37029, 198, 262, 466, 17068, 7552, 553, 271, 262, 1697, 6576, 25, 198, 285, 16782, 12756, 64575, 498, 17896, 52, 2357, 60, 64575, 2423, 64575, 498, 19504, 52, 2357, 60, 64575, 16782, 34298, 271, 262, 471, 16782, 12756, 4381, 369, 279, 1379, 5742, 1429, 2357, 13, 198, 262, 471, 16782, 34298, 28044, 369, 279, 3140, 5742, 1429, 2357, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279], "info": "DONE 512 36 440.6 6841.7 length 337 450 0 167213 253078 74069 0 0.0 36 9955 chunk=0 experts_streamed=0", "sha": "0703822025adc5cd", "gpu": {"0": {"util": 93.9, "power_w": 158.6, "n": 37}}}, {"kind": "facts", "gen": 503, "tok_s": 72.77830830222531, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 11, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 279, 1118, 11247, 7172, 1472, 34780, 19292, 4598, 1056, 74765, 24026, 21254, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 279, 12570, 1785, 440, 6681, 7810, 3813, 31784, 13, 248046], "info": "DONE 503 37 451.3 6911.4 stop 319 458 0 188175 264676 66806 0 0.0 37 8226 chunk=0 experts_streamed=0", "sha": "def9b9bededd44f5", "gpu": {"0": {"util": 96.5, "power_w": 160.6, "n": 36}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1057.827471918082, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 15508.2 149.8 length 4 6 0 983 3642 1927 0 0.0 16405 303 chunk=8192 experts_streamed=48042", "tok_s": null, "gpu": {"0": {"util": 96.2, "power_w": 165.2, "n": 79}}, "sha": "84d46cd5a99fc0a9"}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/p2003/p1-single/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/p2003/p1-single/summary.txt
new file mode 100644
index 000000000..015138f0d
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/p2003/p1-single/summary.txt
@@ -0,0 +1,36 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | story:tok_s | 60.84 | 1.000 | 0/5 | 5
+overlap | story:tok_s | 57.15 | 0.939 | 1/5 | 5
+default2 | story:tok_s | 58.45 | 0.961 | 2/5 | 5
+default | code:tok_s | 73.31 | 1.000 | 0/5 | 5
+overlap | code:tok_s | 70.42 | 0.961 | 0/5 | 5
+default2 | code:tok_s | 71.61 | 0.977 | 1/5 | 5
+default | facts:tok_s | 72.78 | 1.000 | 0/5 | 5
+overlap | facts:tok_s | 70.71 | 0.972 | 2/5 | 5
+default2 | facts:tok_s | 71.70 | 0.985 | 4/5 | 5
+default | pp16k:pp_tok_s | 1056.99 | 1.000 | 0/5 | 5
+overlap | pp16k:pp_tok_s | 1055.63 | 0.999 | 2/5 | 5
+default2 | pp16k:pp_tok_s | 1049.49 | 0.993 | 1/5 | 5
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | story | gpu0 95 | 160 | 5
+default | code | gpu0 94 | 157 | 6
+default | facts | gpu0 95 | 158 | 5
+default | pp16k | gpu0 96 | 165 | 4
+overlap | story | gpu0 95 | 157 | 5
+overlap | code | gpu0 95 | 155 | 5
+overlap | facts | gpu0 94 | 157 | 6
+overlap | pp16k | gpu0 96 | 165 | 4
+default2 | story | gpu0 95 | 159 | 5
+default2 | code | gpu0 96 | 156 | 4
+default2 | facts | gpu0 95 | 158 | 5
+default2 | pp16k | gpu0 96 | 166 | 4
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+story: 7 distinct -> 033f8528b3200257:default,default2,overlap; 2716f6f2fc99292c:default,default2,overlap; 4052d318cba851cb:default; b4a3057bdecccf4f:default2; adc32395466acb00:default; c17b144815b999df:overlap; 2f4f22980c51f841:overlap
+code: 10 distinct -> 0703822025adc5cd:default,overlap; ac5c27594626917e:default2,overlap; 1d4835a2b000cab1:default2; 67d321d92de13695:default; f3d41c60d98f1350:default2; ae301750e1e37258:default; 479384a12bcbf66d:overlap; 8ed63b77cb9b53a0:default,default2; 4e821729b15eb132:default2; befb3506d31053b3:overlap
+facts: 11 distinct -> def9b9bededd44f5:default,overlap; b9418f1083429dad:overlap; 2aae9df816677cc0:default2; aa63d8e104525a97:default2; ae3d3e64d0680f38:default; 1dfba8ccf3d25593:default2; 9773a821d035b4c7:default; eb599068c53e8662:overlap; 929e1f8cbb2392cb:default,default2; 0ea64dbce799a869:default2; 130b3ef0071e1d05:overlap
+pp16k: 1 distinct
+default: expert-cache slots ['3355']
+overlap: expert-cache slots ['3355']
+default2: expert-cache slots ['3355']
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1-single/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1-single/results.jsonl
new file mode 100644
index 000000000..81cd734fe
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1-single/results.jsonl
@@ -0,0 +1,20 @@
+{"round": 0, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 80.88850972399956, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 27373, 8545, 11, 21861, 279, 8529, 998, 27044, 13, 1216, 33757, 424, 28314, 13, 357, 36334, 427, 4476, 33172, 494, 2785, 13, 271, 16214, 31119, 11, 264, 35093, 82697, 995, 3272, 1248, 5418, 11, 72293, 303, 780, 14697, 13, 1216, 11354, 279, 16002, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 8545, 36620, 1898, 303, 780, 5214, 30439, 13, 561, 2956, 557, 32335, 25, 264, 45996, 11, 264, 42558, 11, 264, 26748, 314, 6265, 11, 321, 279, 1898, 13], "info": "DONE 512 33 313.5 6329.7 length 254 463 0 334189 340593 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "1c01746bd4aa8c79", "gpu": {"0": {"util": 44.7, "power_w": 121.7, "n": 33}, "1": {"util": 58.7, "power_w": 128.3, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 97.52380952380953, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 9266, 1906, 318, 1445, 1901, 310, 9495, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572], "info": "DONE 512 36 293.2 5250.0 length 332 452 0 282046 294148 0 0 0.0 36 1109 chunk=0 experts_streamed=0", "sha": "4b313919e85e39b4", "gpu": {"0": {"util": 44.9, "power_w": 120.0, "n": 27}, "1": {"util": 60.1, "power_w": 126.8, "n": 27}}}, {"kind": "facts", "gen": 494, "tok_s": 92.9444967074318, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 37847, 1834, 314, 866, 11247, 11, 25720, 264, 12331, 303, 1066, 220, 24, 13, 24, 3979, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 682, 279, 1379, 77396, 314, 866, 11247, 11, 440, 220, 24, 20, 10457, 5629, 45052, 430, 314, 220, 17, 15, 17, 18, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 494 37 389.4 5315.0 stop 317 438 0 266408 282884 0 0 0.0 37 1668 chunk=0 experts_streamed=0", "sha": "d02ccf8df3989951", "gpu": {"0": {"util": 42.9, "power_w": 118.8, "n": 29}, "1": {"util": 61.2, "power_w": 124.8, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1652.4305485606076, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9927.8 147.2 length 5 5 0 2820 3798 0 0 0.0 16405 184 chunk=8192 experts_streamed=35909", "tok_s": null, "gpu": {"0": {"util": 53.7, "power_w": 103.2, "n": 50}, "1": {"util": 61.2, "power_w": 100.1, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2920.3178140311097, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20552.9 144.7 length 3 4 16384 3337 3928 0 0 0.0 43637 67 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.8, "power_w": 118.7, "n": 104}, "1": {"util": 80.0, "power_w": 122.2, "n": 104}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "overlap", "slots": "7342", "notes": ["strata serve: layer split: layers 0-24 (CUDA0), 25-47 (CUDA1), one hand-off per window (overlapped: STRATA_SPLIT_OVERLAP=1)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.44500982255, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 313.0 6210.2 length 259 463 0 330635 337158 0 0 0.0 33 125 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 43.6, "power_w": 120.1, "n": 33}, "1": {"util": 93.2, "power_w": 128.9, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 97.87429270530662, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 9266, 1906, 318, 1445, 1901, 310, 9495, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264], "info": "DONE 512 36 291.0 5231.2 length 329 442 0 277089 289285 0 0 0.0 36 1172 chunk=0 experts_streamed=0", "sha": "a7e4a1c48e84b906", "gpu": {"0": {"util": 44.7, "power_w": 120.4, "n": 27}, "1": {"util": 93.9, "power_w": 127.5, "n": 27}}}, {"kind": "facts", "gen": 489, "tok_s": 92.38791588732076, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 1007, 303, 279, 12570, 1785, 11, 25720, 449, 25659, 2094, 279, 7806, 303, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 489 37 386.1 5292.9 stop 313 440 0 267321 283615 0 0 0.0 37 1772 chunk=0 experts_streamed=0", "sha": "c229bdca374702de", "gpu": {"0": {"util": 45.2, "power_w": 118.8, "n": 29}, "1": {"util": 94.9, "power_w": 125.6, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1654.0966746657525, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9917.8 137.7 length 4 4 0 2546 3369 0 0 0.0 16405 155 chunk=8192 experts_streamed=35916", "tok_s": null, "gpu": {"0": {"util": 63.0, "power_w": 108.9, "n": 50}, "1": {"util": 54.2, "power_w": 110.2, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2968.4563492848524, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20219.6 145.8 length 3 4 16384 3334 3929 0 0 0.0 43637 72 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.4, "power_w": 119.2, "n": 102}, "1": {"util": 78.0, "power_w": 122.9, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "pw2", "slots": "7156", "notes": ["strata generate: note: --pipeline-windows 2 on a layer split of two stages without the draft layer on the first card (STRATA_MTP_STAGE0=1 asks for it): the draft chain then shares the last card with its window and the pipeline lost to the serial loop on 2x R9700 before 0.1.44 (docs/MULTI_GPU.md); kept as asked, --pipeline-windows 0 turns it off", "strata generate: --pipeline-windows 2: 278 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 78.09044459696484, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 49577, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 28486, 310, 279, 1814, 7551, 279, 32946, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 271, 1465, 11815, 7249, 11, 3462, 364, 279, 338, 68042, 421, 58330, 506, 279, 20618, 725, 15686, 321, 279, 26957, 7892, 14882, 421, 11136, 2957, 264, 2182, 11, 12314, 259, 19936, 3487, 11, 580, 6067, 1885, 11, 321, 30457, 421, 998, 2582, 2250, 5381, 2235, 13, 82697, 14459, 424, 411, 1560, 13, 561, 48331, 557, 264, 1925, 314, 11639, 11, 314, 16175, 11, 314, 1208, 852, 6749, 506, 488, 321, 5312, 1132, 1092, 781, 4674, 310, 1436, 13, 5514, 11, 506, 279, 6607, 314, 279, 30701, 11, 551, 557, 4777, 264, 709, 13, 357, 3000, 303, 279, 6121, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 78080, 279, 21678, 1083, 264, 12431, 1540, 2093, 35360, 2176, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 94682, 11, 264, 13727, 551, 8341, 310, 1716, 364, 32871, 421, 2493, 5383, 279, 15787, 466, 11, 777, 22103, 11, 310, 1353, 364, 279, 2433, 279, 9117, 6348, 685, 13, 1216, 14428, 440, 780, 1901, 1441, 11, 6213, 33939, 279, 13988, 9002, 364, 32524, 6451, 11, 89644, 580, 1222, 11, 466, 279, 26957, 11840, 16002, 421, 995, 26880, 279, 36958, 314, 279, 32757, 27588, 13, 271, 760, 40554, 557, 54900, 3238, 11, 44431, 264, 14084, 314, 25888, 3438, 22317, 421, 998, 5802, 81179, 13, 1577, 82697, 23562, 15060, 888, 264, 47966, 10582, 314, 65562, 11, 2414, 10255, 279, 8858, 314, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 2682, 390, 314, 8720, 11, 6130, 279, 6121, 2973, 314, 63993, 11708, 13, 1049, 557, 264, 7960, 314, 1829, 2218, 85, 10349, 505, 11, 77959, 11, 321, 35916, 2272, 279, 19177, 74574, 3432, 314, 279, 10994, 13, 271, 1465, 23928, 424, 13569, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 1049, 557, 264, 16002, 13, 1921, 524, 1066, 866, 16002, 13, 1049, 557, 264, 8545, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 16829, 440, 264, 11702, 11, 19499, 4342, 21630, 314, 39611, 13, 561, 21630, 557, 1374, 41476, 11, 12066, 3726], "info": "DONE 512 33 249.3 6556.5 length 239 462 0 417442 424618 0 0 0.0 33 126 chunk=0 experts_streamed=0", "sha": "8fbd675f2b34b5e3", "gpu": {"0": {"util": 75.5, "power_w": 131.1, "n": 34}, "1": {"util": 75.7, "power_w": 134.2, "n": 34}}}, {"kind": "code", "gen": 512, "tok_s": 102.67928766244185, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 2, 51301, 220, 16, 25, 11747, 51425, 318, 29292, 291, 8, 198, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 1005, 43072, 5287, 1714, 52560, 13061, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 1608, 12654, 579, 51425, 13, 271, 262, 51425, 30941, 34736, 1906, 13, 1165, 958, 3166, 2270, 6018, 363, 310, 198, 262, 1804, 449, 1455, 430, 328, 45085, 391, 1429, 1, 321, 2341, 1163, 22634, 5433, 8, 310, 3514, 823, 198, 262, 279, 3140, 5742, 1429, 1455, 13, 271, 262, 3984, 68230, 25, 198, 285, 471, 615, 25, 220, 496, 7, 16, 8, 198, 285, 471, 2113, 25, 220, 496, 7, 16, 8, 198, 262, 11156, 68230, 25, 496, 49657, 3883, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 198, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 51425, 363, 220, 653, 1328, 1411, 869, 11, 11128, 539, 10121, 271, 262, 687, 615, 1153, 11, 1328, 1590, 198, 285, 4071, 198, 285, 30523, 279, 869, 364, 279, 2574, 1328, 13, 271, 285, 1368, 279, 1328, 6513, 11, 424, 369, 7481, 310, 279, 809, 318, 44816, 430, 5742, 1429, 553, 198, 285, 1368, 279, 1328, 1503, 524, 2905, 11, 460, 471, 16, 13, 271, 285, 17167, 25, 198, 309, 1328, 25, 561, 1328, 310, 1353, 685, 13, 271, 285, 5019, 25, 198, 309, 561, 19954, 869, 413, 1669, 11, 5752, 471, 16, 13, 198, 285, 4071, 198, 285, 413, 1328, 524, 303, 638, 19474, 25, 198, 309, 460, 471, 16, 198, 285, 653, 14142, 279, 23975, 1328, 310, 279, 809, 318, 3444, 5742, 1429, 8, 198, 285, 638, 19474, 13242, 2270, 6018, 4702, 8, 198, 285, 460, 638, 19474, 7900, 60, 271, 262, 687, 2113, 1153, 11, 1328, 11, 869, 1590, 198, 285], "info": "DONE 512 36 239.1 4986.4 length 325 465 0 337499 355009 0 0 0.0 36 1681 chunk=0 experts_streamed=0", "sha": "14d88a4c13be63b7", "gpu": {"0": {"util": 72.0, "power_w": 131.9, "n": 26}, "1": {"util": 74.6, "power_w": 133.4, "n": 26}}}, {"kind": "facts", "gen": 476, "tok_s": 92.09991680049532, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 37847, 1834, 314, 866, 11247, 11, 25720, 264, 12331, 303, 1066, 220, 24, 13, 24, 3979, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 279, 1379, 314, 866, 11247, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 62409, 4031, 11, 25720, 264, 1007, 303, 1066, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 476 37 349.1 5168.3 stop 294 452 0 327269 348347 0 0 0.0 37 2265 chunk=0 experts_streamed=0", "sha": "51ba6909cd7a9706", "gpu": {"0": {"util": 62.0, "power_w": 129.2, "n": 28}, "1": {"util": 72.0, "power_w": 132.4, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1653.2132095816833, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9923.1 149.5 length 4 4 0 2644 3685 0 0 0.0 16405 216 chunk=8192 experts_streamed=36570", "tok_s": null, "gpu": {"0": {"util": 56.1, "power_w": 110.6, "n": 50}, "1": {"util": 67.4, "power_w": 108.2, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2953.687619028872, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20320.7 175.3 length 3 5 16384 3079 4311 0 0 0.0 43637 239 chunk=8192 experts_streamed=103608", "tok_s": null, "gpu": {"0": {"util": 72.5, "power_w": 119.9, "n": 103}, "1": {"util": 80.4, "power_w": 122.7, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.36013254833833, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 311.9 6216.6 length 259 463 0 330623 337168 0 0 0.0 33 124 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 44.6, "power_w": 122.5, "n": 32}, "1": {"util": 58.3, "power_w": 128.3, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 100.51435077937886, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 9495, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 7261, 5742, 1429, 3008, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 87401, 5742, 1429, 3008, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 1061, 369, 264, 12755, 421, 632, 15412, 279, 2357, 494, 1141, 18146, 13], "info": "DONE 512 36 293.7 5093.8 length 337 439 0 271205 283899 0 0 0.0 36 1318 chunk=0 experts_streamed=0", "sha": "7ce67910a72be85f", "gpu": {"0": {"util": 45.8, "power_w": 120.0, "n": 27}, "1": {"util": 59.7, "power_w": 125.5, "n": 27}}}, {"kind": "facts", "gen": 477, "tok_s": 93.3920704845815, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 1942, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 477 37 384.0 5107.5 stop 310 425 0 254704 271648 0 0 0.0 37 1870 chunk=0 experts_streamed=0", "sha": "aeff37ca994e506e", "gpu": {"0": {"util": 45.9, "power_w": 117.6, "n": 28}, "1": {"util": 62.8, "power_w": 124.7, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1624.74002178865, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 10097.0 135.0 length 4 4 0 2573 3377 0 0 0.0 16405 151 chunk=8192 experts_streamed=35930", "tok_s": null, "gpu": {"0": {"util": 57.7, "power_w": 108.4, "n": 51}, "1": {"util": 61.9, "power_w": 109.4, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2936.8935601779135, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20436.9 145.4 length 3 4 16384 3372 3935 0 0 0.0 43637 73 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 76.0, "power_w": 119.7, "n": 103}, "1": {"util": 78.3, "power_w": 123.0, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "overlap", "slots": "7342", "notes": ["strata serve: layer split: layers 0-24 (CUDA0), 25-47 (CUDA1), one hand-off per window (overlapped: STRATA_SPLIT_OVERLAP=1)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.35350887069534, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 314.5 6217.1 length 259 460 0 329184 335731 0 0 0.0 33 126 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 46.2, "power_w": 120.9, "n": 33}, "1": {"util": 94.7, "power_w": 128.6, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 95.64015392087272, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 9266, 1906, 318, 1445, 1901, 310, 9495, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 359, 447, 1170, 3166, 23975, 2357, 310, 1066, 1238, 1901, 318, 3444, 5742, 1429, 553, 198, 262, 1848, 359, 611, 1170, 884, 28856, 2357, 506, 1901, 26, 413, 888, 8390, 11, 3921, 2357, 1518, 9495, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25], "info": "DONE 512 36 294.2 5353.4 length 327 449 0 283189 295218 0 0 0.0 36 1153 chunk=0 experts_streamed=0", "sha": "bc30fe07ca8e50d3", "gpu": {"0": {"util": 45.9, "power_w": 120.5, "n": 28}, "1": {"util": 94.6, "power_w": 126.5, "n": 28}}}, {"kind": "facts", "gen": 495, "tok_s": 94.33422903207364, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 495 37 390.4 5247.3 stop 318 428 0 263287 278641 0 0 0.0 37 1606 chunk=0 experts_streamed=0", "sha": "5c9a13ac44c56caa", "gpu": {"0": {"util": 46.2, "power_w": 118.3, "n": 28}, "1": {"util": 93.8, "power_w": 127.0, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1649.4399646081765, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9945.8 138.8 length 4 4 0 2506 3340 0 0 0.0 16405 166 chunk=8192 experts_streamed=35874", "tok_s": null, "gpu": {"0": {"util": 55.2, "power_w": 109.1, "n": 51}, "1": {"util": 60.6, "power_w": 110.3, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2958.623341285959, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20286.8 155.8 length 4 5 16384 3608 4320 0 0 0.0 43637 97 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 81.0, "power_w": 120.0, "n": 102}, "1": {"util": 76.5, "power_w": 123.7, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "pw2", "slots": "7156", "notes": ["strata generate: note: --pipeline-windows 2 on a layer split of two stages without the draft layer on the first card (STRATA_MTP_STAGE0=1 asks for it): the draft chain then shares the last card with its window and the pipeline lost to the serial loop on 2x R9700 before 0.1.44 (docs/MULTI_GPU.md); kept as asked, --pipeline-windows 0 turns it off", "strata generate: --pipeline-windows 2: 278 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.29694024992457, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 49577, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 28486, 310, 279, 1814, 7551, 279, 32946, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 271, 1465, 11815, 7249, 11, 3462, 364, 279, 338, 68042, 421, 58330, 506, 279, 20618, 725, 15686, 321, 279, 26957, 7892, 14882, 421, 11136, 2957, 264, 2182, 11, 12314, 259, 19936, 3487, 11, 580, 6067, 1885, 11, 321, 30457, 421, 998, 2582, 2250, 5381, 2235, 13, 82697, 14459, 424, 411, 1560, 13, 561, 48331, 557, 264, 1925, 314, 11639, 11, 314, 16175, 11, 314, 1208, 852, 6749, 506, 488, 321, 5312, 1132, 1092, 781, 4674, 310, 1436, 13, 5514, 11, 506, 279, 6607, 314, 279, 30701, 11, 551, 557, 4777, 264, 709, 13, 357, 3000, 303, 279, 6121, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 274, 40101, 4396, 276, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 2255, 11, 12910, 279, 15787, 25374, 364, 43369, 11, 948, 551, 5312, 424, 13, 1049, 557, 4139, 1402, 322, 1086, 303, 279, 9002, 3043, 279, 40554, 1500, 11, 10255, 303, 264, 259, 3908, 314, 580, 1222, 321, 32524, 6451, 13, 271, 2064, 557, 264, 16002, 13, 271, 2536, 264, 6278, 11840, 25347, 11, 694, 264, 11702, 11, 32709, 3045, 30615, 8720, 16002, 11, 18473, 440, 34830, 421, 995, 68342, 1083, 264, 6121, 11, 39943, 46912, 13, 1049, 6749, 13437, 11, 1141, 7099, 1778, 2320, 440, 279, 63523, 314, 10476, 314, 14946, 9407, 303, 279, 5365, 13, 82697, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 6235, 13, 1216, 33757, 424, 28314, 13, 357, 8153, 348, 549, 741, 9, 33172, 494, 2785, 13, 271, 16214, 31119, 11, 264, 35093, 82697, 995, 3272, 1248, 5418, 11, 72293, 303, 780, 14697, 13, 1216, 11354, 279, 16002, 1142, 310, 279, 51624, 725, 44104, 11, 264, 2526, 9506, 5759, 12037, 310, 279, 2255, 314, 279, 20618, 13, 26482, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38936, 37260, 13, 1216, 8826, 279, 16002, 383, 780, 944], "info": "DONE 512 33 252.1 6297.9 length 249 443 0 405073 412344 0 0 0.0 33 129 chunk=0 experts_streamed=0", "sha": "2fa43bd4ebb13cd1", "gpu": {"0": {"util": 73.5, "power_w": 132.1, "n": 33}, "1": {"util": 74.6, "power_w": 133.4, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 104.34073772162216, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 3929, 318, 17896, 52, 553, 198, 262, 471, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 198, 406, 3514, 29015, 279, 9495, 2357, 318, 19504, 52, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 17896, 52, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 19504, 52, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153], "info": "DONE 512 36 244.7 4907.0 length 328 459 0 338141 353045 0 0 0.0 36 1494 chunk=0 experts_streamed=0", "sha": "66fa0cc96f94efbd", "gpu": {"0": {"util": 81.9, "power_w": 130.9, "n": 26}, "1": {"util": 73.2, "power_w": 133.7, "n": 26}}}, {"kind": "facts", "gen": 487, "tok_s": 94.76183063511832, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 93448, 47837, 11, 279, 78802, 63004, 303, 279, 12570, 1785, 506, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 7810, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 1942, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 62409, 17800, 23245, 494, 220, 23, 23, 2756, 318, 25863, 24648, 8, 310, 220, 16, 21, 20, 1578, 318, 8547, 50168, 553, 248046], "info": "DONE 487 37 333.1 5139.2 stop 306 449 0 327135 348810 0 0 0.0 37 2435 chunk=0 experts_streamed=0", "sha": "c6f93065d8f41796", "gpu": {"0": {"util": 70.7, "power_w": 129.9, "n": 27}, "1": {"util": 77.8, "power_w": 131.4, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1648.8762915611303, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9949.2 145.0 length 4 4 0 2664 3675 0 0 0.0 16405 215 chunk=8192 experts_streamed=36638", "tok_s": null, "gpu": {"0": {"util": 55.7, "power_w": 111.5, "n": 50}, "1": {"util": 59.5, "power_w": 109.1, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2969.6900728309056, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20211.2 171.5 length 3 5 16384 3113 4333 0 0 0.0 43637 224 chunk=8192 experts_streamed=103608", "tok_s": null, "gpu": {"0": {"util": 81.3, "power_w": 120.1, "n": 102}, "1": {"util": 75.4, "power_w": 123.1, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 77.68168714914276, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 11, 27044, 440, 2414, 4613, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 1216, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1690, 264, 1248, 854, 11, 551, 1066, 42578, 506, 424, 13, 1049, 6273, 1040], "info": "DONE 512 33 314.9 6591.0 length 258 464 0 332315 338711 0 0 0.0 33 123 chunk=0 experts_streamed=0", "sha": "afd22e324d2d9940", "gpu": {"0": {"util": 48.4, "power_w": 119.2, "n": 35}, "1": {"util": 54.1, "power_w": 126.3, "n": 35}}}, {"kind": "code", "gen": 512, "tok_s": 97.37172416416264, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 4523, 869, 413, 1328, 6513, 11, 745, 471, 16, 13, 54704, 23975, 2357, 310, 1901, 13, 198, 262, 471, 2113, 4702, 11, 869, 1590, 47640, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 3514, 29015, 9495, 2357, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153], "info": "DONE 512 36 293.8 5258.2 length 342 438 0 268812 281757 0 0 0.0 36 1405 chunk=0 experts_streamed=0", "sha": "15610d42ccbd81d7", "gpu": {"0": {"util": 49.4, "power_w": 119.0, "n": 27}, "1": {"util": 54.3, "power_w": 124.7, "n": 27}}}, {"kind": "facts", "gen": 466, "tok_s": 93.64199019371435, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 466 37 409.7 4976.4 stop 306 414 0 248698 264552 0 0 0.0 37 1666 chunk=0 experts_streamed=0", "sha": "c5fb683f831e986e", "gpu": {"0": {"util": 41.3, "power_w": 117.1, "n": 27}, "1": {"util": 58.6, "power_w": 124.3, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.0967288781858, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9966.0 134.1 length 4 4 0 2561 3341 0 0 0.0 16405 155 chunk=8192 experts_streamed=35971", "tok_s": null, "gpu": {"0": {"util": 52.8, "power_w": 109.0, "n": 51}, "1": {"util": 66.1, "power_w": 110.5, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2957.894321844292, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20291.8 153.3 length 4 5 16384 3686 4356 0 0 0.0 43637 77 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 66.8, "power_w": 120.0, "n": 102}, "1": {"util": 79.8, "power_w": 123.3, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.40520182836542, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 315.3 6213.2 length 259 462 0 330116 336671 0 0 0.0 33 124 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 44.5, "power_w": 121.7, "n": 33}, "1": {"util": 58.0, "power_w": 128.7, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 97.28476695358074, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 2, 51301, 220, 16, 25, 11747, 51425, 318, 29292, 291, 8, 198, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 1005, 43072, 5287, 1714, 52560, 13061, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 1608, 12654, 579, 51425, 13, 271, 262, 51425, 30941, 34736, 1906, 13, 1165, 958, 3166, 2270, 6018, 363, 310, 198, 262, 1804, 449, 1455, 430, 5742, 1429, 11, 321, 2341, 1163, 22634, 5433, 8, 310, 3514, 823, 198, 262, 279, 3140, 5742, 1429, 1455, 13, 271, 262, 3984, 68230, 25, 198, 285, 471, 615, 25, 220, 496, 7, 16, 8, 198, 285, 471, 2113, 25, 220, 496, 7, 16, 8, 198, 262, 11156, 68230, 25, 198, 285, 471, 496, 49657, 3883, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 198, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 51425, 363, 220, 653, 1328, 1411, 869, 11, 11128, 539, 10121, 271, 262, 687, 615, 1153, 11, 1328, 1590, 198, 285, 4071, 198, 285, 30523, 264, 869, 494, 279, 6297, 13, 271, 285, 1368, 279, 1328, 6513, 11, 424, 369, 7481, 310, 279, 809, 318, 3444, 5742, 1429, 553, 198, 285, 1368, 279, 1328, 1503, 524, 2905, 11, 460, 471, 16, 13, 271, 285, 17167, 25, 198, 309, 1328, 25, 561, 1328, 310, 1353, 685, 13, 271, 285, 5019, 25, 198, 309, 561, 19954, 869, 413, 1669, 11, 5752, 471, 16, 13, 198, 285, 4071, 198, 285, 413, 1328, 524, 303, 638, 19474, 25, 198, 309, 460, 471, 16, 198, 285, 653, 14142, 279, 23975, 1328, 310, 279, 809, 318, 3444, 5742, 1429, 8, 198, 285, 638, 19474, 13242, 2270, 6018, 4702, 8, 198, 285, 460, 638, 19474, 7900, 60, 271, 262, 687, 2113, 1153, 11, 1328, 11, 869, 1590, 198, 285, 4071], "info": "DONE 512 36 294.9 5262.9 length 335 441 0 270029 284678 0 0 0.0 36 1563 chunk=0 experts_streamed=0", "sha": "612774bf7ff21027", "gpu": {"0": {"util": 42.1, "power_w": 118.0, "n": 27}, "1": {"util": 53.6, "power_w": 126.6, "n": 27}}}, {"kind": "facts", "gen": 472, "tok_s": 93.64336163796524, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 25, 28686, 11, 37222, 11, 47437, 1544, 14880, 11, 321, 6920, 24534, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 472 37 395.8 5040.4 stop 310 418 0 250036 266855 0 0 0.0 37 1797 chunk=0 experts_streamed=0", "sha": "cb02e14bcab3e033", "gpu": {"0": {"util": 45.1, "power_w": 118.3, "n": 28}, "1": {"util": 61.2, "power_w": 125.7, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1649.1415014676907, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9947.6 152.2 length 5 5 0 2692 3730 0 0 0.0 16405 206 chunk=8192 experts_streamed=35932", "tok_s": null, "gpu": {"0": {"util": 68.8, "power_w": 109.0, "n": 50}, "1": {"util": 56.6, "power_w": 108.7, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2961.864532238485, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20264.6 145.8 length 3 4 16384 3286 3900 0 0 0.0 43637 65 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 76.8, "power_w": 120.2, "n": 102}, "1": {"util": 76.4, "power_w": 123.4, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "pw2", "slots": "7156", "notes": ["strata generate: note: --pipeline-windows 2 on a layer split of two stages without the draft layer on the first card (STRATA_MTP_STAGE0=1 asks for it): the draft chain then shares the last card with its window and the pipeline lost to the serial loop on 2x R9700 before 0.1.44 (docs/MULTI_GPU.md); kept as asked, --pipeline-windows 0 turns it off", "strata generate: --pipeline-windows 2: 278 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 80.78003218579407, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 49577, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 28486, 310, 279, 1814, 7551, 279, 32946, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 271, 1465, 11815, 7249, 11, 3462, 364, 279, 338, 68042, 421, 58330, 506, 279, 20618, 725, 15686, 321, 279, 26957, 7892, 14882, 421, 11136, 2957, 264, 2182, 13, 561, 29310, 557, 524, 264, 23339, 26, 424, 557, 264, 5576, 13, 82697, 995, 27968, 279, 11639, 314, 279, 3177, 11, 279, 52010, 314, 11532, 11, 321, 279, 57040, 7244, 310, 381, 348, 86400, 9, 303, 264, 1814, 421, 14459, 1384, 310, 381, 874, 799, 13, 5514, 11, 551, 557, 4777, 279, 51624, 13, 561, 3000, 13, 561, 6570, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 78080, 279, 21678, 1083, 264, 12431, 25577, 11, 17960, 17024, 11, 421, 279, 16002, 9434, 13, 271, 36, 69388, 557, 11107, 279, 94682, 11, 264, 13727, 551, 8341, 310, 1716, 364, 32871, 421, 2493, 5383, 279, 15787, 466, 11, 777, 22103, 11, 310, 2708, 279, 1752, 364, 279, 7892, 14882, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 25888, 3438, 26748, 314, 3565, 6730, 421, 5802, 10641, 81179, 13, 2532, 11, 85624, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 580, 1222, 321, 9002, 11, 557, 264, 8720, 16002, 13, 271, 2064, 557, 524, 264, 6278, 16002, 13, 1049, 557, 11702, 11, 6121, 5983, 8720, 11, 18473, 440, 264, 86249, 421, 995, 6316, 3565, 440, 4092, 13, 561, 2306, 11, 413, 1017, 3397, 557, 799, 11, 995, 1248, 2394, 53798, 13, 82697, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 6235, 13, 1216, 33757, 424, 13, 357, 36334, 427, 4476, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 23221, 279, 24149, 77371, 314, 279, 8799, 44286, 13, 561, 13071, 4732, 557, 6941, 310, 1204, 75, 11, 54651, 2631, 279, 3136, 822, 287, 13, 82697, 7338, 1441, 11, 780, 5888, 88818, 9781, 60723, 494, 8981, 11, 694, 494, 264, 10647, 11, 58609, 8415, 13, 733, 25292, 36165, 1578, 11, 551, 995, 1669, 32524, 6451, 11, 11840, 11, 5418, 7397, 11, 321, 2957, 11, 264, 22353], "info": "DONE 512 33 252.7 6338.2 length 245 427 0 405663 412775 0 0 0.0 33 137 chunk=0 experts_streamed=0", "sha": "d43b672bf7be1cb1", "gpu": {"0": {"util": 81.5, "power_w": 131.7, "n": 33}, "1": {"util": 74.0, "power_w": 134.5, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 101.61149480034928, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 318, 39470, 364, 75555, 494, 279, 5010, 2336, 8, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 5533, 1330, 77991, 7552, 318, 30358, 1901, 321, 16782, 9495, 8, 198, 262, 310, 38406, 6607, 37208, 11256, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 37029, 198, 262, 466, 17068, 7552, 553, 271, 262, 9266, 1906, 25, 198, 285, 1901, 64575, 2423, 64575, 9495, 198, 285, 318, 3444, 3110, 8, 257, 318, 53415, 3110, 8, 271, 262, 1848, 1510, 447, 43143, 3166, 279, 23975, 2357, 310, 1066, 1238, 1901, 13, 198, 262, 1848, 1510, 611, 43143, 5479, 491, 2357, 1238, 1901, 26, 413, 888, 8390, 11, 3921, 2357, 1518, 9495, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324], "info": "DONE 512 36 242.8 5038.8 length 318 462 0 347349 361885 0 0 0.0 36 1300 chunk=0 experts_streamed=0", "sha": "e4171b7711cde5ce", "gpu": {"0": {"util": 72.7, "power_w": 129.7, "n": 26}, "1": {"util": 79.0, "power_w": 134.8, "n": 26}}}, {"kind": "facts", "gen": 490, "tok_s": 94.82158061769485, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 1007, 303, 279, 12570, 1785, 11, 25720, 449, 25659, 2094, 279, 7806, 303, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 490 37 331.7 5167.6 stop 306 469 0 339701 359995 0 0 0.0 37 2195 chunk=0 experts_streamed=0", "sha": "3ca0a27e58fb6bf0", "gpu": {"0": {"util": 77.8, "power_w": 130.6, "n": 28}, "1": {"util": 76.3, "power_w": 132.1, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1652.3972602739727, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9928.0 152.3 length 5 5 0 3040 4147 0 0 0.0 16405 222 chunk=8192 experts_streamed=36601", "tok_s": null, "gpu": {"0": {"util": 58.5, "power_w": 109.9, "n": 50}, "1": {"util": 67.0, "power_w": 110.1, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2966.974300162632, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20229.7 150.6 length 3 5 16384 4054 4982 0 0 0.0 43637 128 chunk=8192 experts_streamed=103608", "tok_s": null, "gpu": {"0": {"util": 76.0, "power_w": 121.2, "n": 102}, "1": {"util": 82.2, "power_w": 122.4, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.24635353081025, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 310.8 6225.2 length 258 462 0 330587 337160 0 0 0.0 33 125 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 45.3, "power_w": 122.0, "n": 33}, "1": {"util": 60.3, "power_w": 128.4, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 102.62577670875928, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 78951, 13126, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 10121, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 1848, 1510, 447, 43143, 198, 406, 220, 16, 13, 8919, 685, 279, 2357, 303, 279, 5010, 2336, 13, 198, 406, 220, 17, 13, 1368, 1669, 11, 3166, 424, 310, 279, 3929, 318, 3444, 5742, 1429, 553, 198, 406, 220, 18, 13, 3301, 1141, 869, 13, 271, 262, 1848, 1510, 611, 43143, 198, 406, 220, 16, 13, 1368, 1328, 6513, 11, 2560, 869, 321, 3166, 310, 3929, 13, 198, 406, 220, 17, 13, 1368, 1328, 3070, 914, 2905, 11, 1791, 264, 491, 2357, 11, 884, 310, 3929, 11, 198, 260, 321, 884, 310, 5010, 2336, 13, 198, 406, 220, 18, 13, 1368, 8390, 369, 32689, 11, 3921, 279, 9495, 2357, 318, 19504, 52, 8, 494, 198, 260, 2107, 279, 10278, 1103, 321, 279, 5010, 2336, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167], "info": "DONE 512 36 294.1 4989.0 length 346 448 0 273163 285424 0 0 0.0 36 1322 chunk=0 experts_streamed=0", "sha": "ec801efea1254ee8", "gpu": {"0": {"util": 43.8, "power_w": 120.3, "n": 26}, "1": {"util": 58.2, "power_w": 126.6, "n": 26}}}, {"kind": "facts", "gen": 471, "tok_s": 94.63342106849369, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 25, 28686, 11, 37222, 11, 47437, 1544, 14880, 11, 321, 6920, 24534, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 7810, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 471 37 381.8 4977.1 stop 305 410 0 250888 265964 0 0 0.0 37 1429 chunk=0 experts_streamed=0", "sha": "c969965f64b1c703", "gpu": {"0": {"util": 42.1, "power_w": 118.7, "n": 27}, "1": {"util": 61.9, "power_w": 124.7, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1648.7271484708697, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9950.1 134.8 length 4 4 0 2526 3346 0 0 0.0 16405 162 chunk=8192 experts_streamed=35933", "tok_s": null, "gpu": {"0": {"util": 63.5, "power_w": 110.2, "n": 50}, "1": {"util": 57.8, "power_w": 109.4, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2960.3890563115606, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20274.7 151.3 length 4 5 16384 3677 4358 0 0 0.0 43637 88 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.6, "power_w": 119.2, "n": 103}, "1": {"util": 76.7, "power_w": 123.1, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.4078544986319, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 310.4 6213.0 length 259 465 0 331528 338117 0 0 0.0 33 125 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 45.7, "power_w": 120.9, "n": 32}, "1": {"util": 60.7, "power_w": 129.8, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 99.41168475622779, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 364, 496, 7, 16, 8, 311, 50123, 321, 264, 5010, 2336, 364, 496, 7, 16, 8, 1353, 8339, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 3555, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 220, 653, 20098, 310, 279, 3555, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 285, 638, 4381, 283, 2168, 220, 653, 20098, 310, 279, 1727, 2357, 318, 83, 79141, 436, 34810, 809, 8, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 198, 406, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 406, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 271, 262, 1848, 359, 447, 1170, 3166, 23975, 2357, 310, 27412, 52, 2234, 13, 198, 262, 1848, 359, 611, 1170, 5479, 28856, 2357, 506, 27412, 52, 2234, 26, 3514, 823, 436, 34810, 2357, 413, 888, 8390, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 38406, 6607, 37208, 11256, 318, 2083, 2168, 11988, 364, 1901, 5350, 589, 8, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 48864, 1901, 318, 17896, 52, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 48864, 9495, 318, 19504, 52, 3008, 8], "info": "DONE 512 36 290.9 5150.3 length 337 436 0 270619 283584 0 0 0.0 36 1432 chunk=0 experts_streamed=0", "sha": "290d5f1bd43f06cb", "gpu": {"0": {"util": 44.6, "power_w": 121.0, "n": 28}, "1": {"util": 60.4, "power_w": 128.4, "n": 28}}}, {"kind": "facts", "gen": 463, "tok_s": 94.45702511373605, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 77396, 321, 264, 12331, 4031, 314, 220, 20, 23, 13, 21, 8964, 2756, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 440, 264, 1834, 27827, 220, 17, 19, 18, 8964, 2756, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 440, 264, 7099, 2982, 314, 220, 20, 16, 15, 3410, 12754, 28495, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 440, 264, 22315, 314, 220, 18, 11, 19, 22, 19, 12754, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 1330, 2526, 77396, 11, 2274, 656, 428, 321, 1526, 23352, 11, 440, 2274, 656, 428, 25659, 286, 303, 220, 22, 13, 21, 3979, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 23769, 53915, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 682, 506, 3140, 220, 16, 19, 21, 3750, 77396, 11, 440, 26557, 1602, 7875, 1056, 42120, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 440, 23267, 8893, 1602, 279, 7526, 506, 220, 16, 11, 20, 22, 23, 12754, 303, 22315, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 440, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 220, 16, 19, 3750, 77396, 11, 440, 81280, 263, 25659, 286, 303, 279, 13600, 4944, 314, 12331, 13, 198, 16, 22, 13, 42120, 682, 279, 37847, 1007, 303, 279, 12570, 1785, 506, 220, 23, 23, 8964, 2756, 13, 198, 16, 23, 13, 48017, 682, 279, 37847, 1834, 314, 866, 11247, 506, 12805, 220, 24, 13, 24, 3979, 13, 198, 16, 24, 13, 47334, 682, 279, 21354, 1834, 314, 866, 11247, 506, 220, 17, 19, 18, 8964, 2756, 13, 198, 17, 15, 13, 76879, 682, 279, 8166, 9662, 23944, 303, 279, 12570, 1785, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 248046], "info": "DONE 463 37 374.9 4901.7 stop 296 419 0 257783 270597 0 0 0.0 37 1248 chunk=0 experts_streamed=0", "sha": "f4024f42ed689588", "gpu": {"0": {"util": 43.5, "power_w": 118.2, "n": 26}, "1": {"util": 62.1, "power_w": 125.7, "n": 26}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.3775679174655, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9964.3 133.8 length 4 4 0 2599 3395 0 0 0.0 16405 133 chunk=8192 experts_streamed=35896", "tok_s": null, "gpu": {"0": {"util": 55.4, "power_w": 109.7, "n": 51}, "1": {"util": 60.0, "power_w": 108.6, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2853.170189098999, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 21036.6 117.6 length 4 4 16384 3053 3506 0 0 0.0 43637 68 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 73.4, "power_w": 118.5, "n": 105}, "1": {"util": 71.8, "power_w": 121.2, "n": 105}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 2, "arm": "overlap", "slots": "7342", "notes": ["strata serve: layer split: layers 0-24 (CUDA0), 25-47 (CUDA1), one hand-off per window (overlapped: STRATA_SPLIT_OVERLAP=1)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.4663951120163, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 70676, 2956, 11, 279, 2172, 17796, 44102, 13569, 11, 23414, 1141, 22690, 680, 1083, 279, 715, 13, 82697, 8826, 279, 16002, 383, 780, 944, 26157, 11, 1172, 279, 24149, 77371, 314, 279, 13017, 27056, 13, 1216, 23354, 279, 24544, 13, 561, 34830, 557, 91380, 11, 49987, 1172, 780, 23297, 13], "info": "DONE 512 33 314.6 6284.8 length 256 465 0 333380 339721 0 0 0.0 33 119 chunk=0 experts_streamed=0", "sha": "31d88ac82bdf6ae5", "gpu": {"0": {"util": 45.5, "power_w": 121.1, "n": 33}, "1": {"util": 93.5, "power_w": 128.8, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 100.69027906153515, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 364, 496, 7, 16, 8, 311, 50123, 321, 264, 5010, 2336, 364, 496, 7, 16, 8, 1353, 8339, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25], "info": "DONE 512 36 294.4 5084.9 length 344 440 0 269150 282055 0 0 0.0 36 1421 chunk=0 experts_streamed=0", "sha": "f5b67e456277df81", "gpu": {"0": {"util": 44.9, "power_w": 119.4, "n": 27}, "1": {"util": 94.0, "power_w": 127.4, "n": 27}}}, {"kind": "facts", "gen": 472, "tok_s": 93.37843986784577, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 25, 28686, 11, 37222, 11, 47437, 1544, 14880, 11, 321, 6920, 24534, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 472 37 389.6 5054.7 stop 309 419 0 251833 268008 0 0 0.0 37 1730 chunk=0 experts_streamed=0", "sha": "cb02e14bcab3e033", "gpu": {"0": {"util": 44.4, "power_w": 117.4, "n": 27}, "1": {"util": 93.9, "power_w": 125.9, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1645.7994743072695, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9967.8 136.5 length 4 4 0 2549 3364 0 0 0.0 16405 151 chunk=8192 experts_streamed=35945", "tok_s": null, "gpu": {"0": {"util": 62.7, "power_w": 109.0, "n": 51}, "1": {"util": 65.4, "power_w": 110.7, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2952.69954495142, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20327.5 144.6 length 3 4 16384 3340 3923 0 0 0.0 43637 68 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 77.9, "power_w": 120.9, "n": 102}, "1": {"util": 80.7, "power_w": 123.4, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.05654208603116, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 27044, 440, 2919, 321, 8106, 2414, 745, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383], "info": "DONE 512 33 313.9 6239.6 length 259 458 0 329478 335863 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "da12ccce0593f5b4", "gpu": {"0": {"util": 43.5, "power_w": 122.6, "n": 32}, "1": {"util": 52.6, "power_w": 127.7, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 98.33106070790683, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 9266, 1906, 318, 1445, 1901, 310, 9495, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264], "info": "DONE 512 36 294.0 5206.9 length 331 448 0 279355 291347 0 0 0.0 36 1127 chunk=0 experts_streamed=0", "sha": "a7e4a1c48e84b906", "gpu": {"0": {"util": 45.1, "power_w": 121.8, "n": 28}, "1": {"util": 57.6, "power_w": 125.8, "n": 28}}}, {"kind": "facts", "gen": 484, "tok_s": 92.63867090303565, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 62409, 4031, 11, 25720, 799, 1007, 303, 1066, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 484 37 391.4 5224.6 stop 309 427 0 261043 277111 0 0 0.0 37 1690 chunk=0 experts_streamed=0", "sha": "8930a996a572e8b6", "gpu": {"0": {"util": 46.2, "power_w": 118.7, "n": 28}, "1": {"util": 56.4, "power_w": 125.5, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1647.2702808543113, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9958.9 135.0 length 4 4 0 2601 3399 0 0 0.0 16405 141 chunk=8192 experts_streamed=35888", "tok_s": null, "gpu": {"0": {"util": 56.5, "power_w": 110.0, "n": 50}, "1": {"util": 64.8, "power_w": 109.8, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2961.6599230237834, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20266.0 142.7 length 3 4 16384 3372 3940 0 0 0.0 43637 58 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.3, "power_w": 118.8, "n": 103}, "1": {"util": 83.5, "power_w": 123.6, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.8636777896807, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 27044, 440, 2919, 321, 8106, 2414, 745, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383], "info": "DONE 512 33 313.2 6254.3 length 258 459 0 330419 336820 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "da12ccce0593f5b4", "gpu": {"0": {"util": 44.1, "power_w": 122.8, "n": 32}, "1": {"util": 56.3, "power_w": 127.5, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 97.7565632458234, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 2, 51301, 220, 16, 25, 11747, 51425, 318, 29292, 291, 8, 198, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 1005, 43072, 5287, 1714, 52560, 13061, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 1608, 12654, 579, 51425, 13, 271, 262, 51425, 30941, 34736, 1906, 13, 1165, 958, 3166, 2270, 6018, 363, 310, 198, 262, 1804, 449, 1455, 430, 328, 45085, 391, 1429, 1, 321, 2341, 1163, 22634, 5433, 8, 310, 3514, 823, 198, 262, 279, 3140, 5742, 1429, 1455, 13, 271, 262, 3984, 68230, 25, 198, 285, 471, 615, 25, 220, 496, 7, 16, 8, 198, 285, 471, 2113, 25, 220, 496, 7, 16, 8, 198, 262, 11156, 68230, 25, 496, 49657, 3883, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 198, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 51425, 363, 220, 653, 1328, 1411, 869, 11, 11128, 539, 10121, 271, 262, 687, 615, 1153, 11, 1328, 25, 514, 8, 1411, 514, 25, 198, 285, 4071, 198, 285, 30523, 279, 869, 364, 279, 2574, 1328, 13, 271, 285, 1368, 279, 1328, 6513, 11, 424, 369, 7481, 310, 279, 809, 318, 44816, 430, 5742, 1429, 553, 198, 285, 1368, 279, 1328, 1503, 524, 2905, 11, 460, 471, 16, 13, 271, 285, 17167, 25, 198, 309, 1328, 25, 561, 1328, 310, 1353, 685, 13, 271, 285, 5019, 25, 198, 309, 561, 19954, 869, 413, 1669, 11, 5752, 471, 16, 13, 198, 285, 4071, 198, 285, 413, 1328, 524, 303, 638, 19474, 25, 198, 309, 460, 471, 16, 198, 285, 653, 14142, 279, 23975, 1328, 310, 279, 809, 310, 1804, 424, 430, 5742, 1429, 198, 285, 638, 19474, 13242, 2270, 6018, 4702, 8, 198, 285, 460, 638, 19474, 7900, 60, 271, 262, 687, 2113, 1153, 11], "info": "DONE 512 36 294.6 5237.5 length 335 439 0 269162 283720 0 0 0.0 36 1540 chunk=0 experts_streamed=0", "sha": "7dd92589ace9f811", "gpu": {"0": {"util": 46.1, "power_w": 121.4, "n": 28}, "1": {"util": 54.4, "power_w": 125.7, "n": 28}}}, {"kind": "facts", "gen": 495, "tok_s": 93.6276456902911, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 10782, 539, 10305, 81232, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 11, 7172, 883, 220, 19, 13, 20, 6873, 12754, 3023, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 24, 13, 561, 5821, 494, 279, 7806, 310, 76879, 369, 12805, 220, 18, 15, 83209, 7896, 318, 33869, 553, 198, 17, 15, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 28043, 883, 220, 16, 21, 11, 15, 15, 15, 12754, 6669, 13, 248046], "info": "DONE 495 37 397.6 5286.9 stop 321 438 0 265312 282053 0 0 0.0 37 1763 chunk=0 experts_streamed=0", "sha": "e52c6aa7891fc91b", "gpu": {"0": {"util": 43.9, "power_w": 118.9, "n": 29}, "1": {"util": 60.7, "power_w": 124.6, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.6089190898233, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9962.9 137.7 length 4 4 0 2506 3351 0 0 0.0 16405 160 chunk=8192 experts_streamed=35905", "tok_s": null, "gpu": {"0": {"util": 52.9, "power_w": 110.4, "n": 50}, "1": {"util": 66.2, "power_w": 110.2, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2956.0733440699755, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20304.3 156.6 length 4 5 16384 3613 4341 0 0 0.0 43637 92 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 72.5, "power_w": 119.7, "n": 102}, "1": {"util": 80.6, "power_w": 123.3, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "overlap", "slots": "7342", "notes": ["strata serve: layer split: layers 0-24 (CUDA0), 25-47 (CUDA1), one hand-off per window (overlapped: STRATA_SPLIT_OVERLAP=1)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.49283021299907, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 70676, 2956, 11, 279, 2172, 17796, 44102, 13569, 11, 23414, 264, 22690, 314, 3000, 421, 38891, 3808, 279, 6121, 2919, 13, 82697, 8826, 279, 16002, 383, 780, 944, 26157, 11, 23221, 279, 7948, 34774, 314, 279, 5415, 27056, 13, 1216, 23354, 424, 364, 3979, 11, 12680, 424, 888, 303, 780], "info": "DONE 512 33 312.9 6206.6 length 257 454 0 327708 334029 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "15ebcf29b5162678", "gpu": {"0": {"util": 44.7, "power_w": 120.8, "n": 33}, "1": {"util": 92.6, "power_w": 128.2, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 99.83231291190577, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285, 7624, 4922], "info": "DONE 512 36 292.2 5128.6 length 340 450 0 273392 286951 0 0 0.0 36 1520 chunk=0 experts_streamed=0", "sha": "45f9ca588c8a6dc8", "gpu": {"0": {"util": 45.3, "power_w": 120.0, "n": 27}, "1": {"util": 93.9, "power_w": 127.3, "n": 27}}}, {"kind": "facts", "gen": 476, "tok_s": 93.49833038695738, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 7810, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 1942, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 476 37 380.4 5091.0 stop 306 430 0 260854 276252 0 0 0.0 37 1539 chunk=0 experts_streamed=0", "sha": "c28d387b00ba4408", "gpu": {"0": {"util": 43.6, "power_w": 118.6, "n": 27}, "1": {"util": 94.9, "power_w": 126.2, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1648.594599483464, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9950.9 135.2 length 4 4 0 2563 3369 0 0 0.0 16405 142 chunk=8192 experts_streamed=35941", "tok_s": null, "gpu": {"0": {"util": 54.9, "power_w": 110.4, "n": 50}, "1": {"util": 66.5, "power_w": 110.0, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2962.025316455696, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 20263.5 119.3 length 4 4 16384 3008 3479 0 0 0.0 43637 80 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 76.8, "power_w": 119.6, "n": 102}, "1": {"util": 83.1, "power_w": 123.3, "n": 102}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 3, "arm": "pw2", "slots": "7156", "notes": ["strata generate: note: --pipeline-windows 2 on a layer split of two stages without the draft layer on the first card (STRATA_MTP_STAGE0=1 asks for it): the draft chain then shares the last card with its window and the pipeline lost to the serial loop on 2x R9700 before 0.1.44 (docs/MULTI_GPU.md); kept as asked, --pipeline-windows 0 turns it off", "strata generate: --pipeline-windows 2: 278 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 83.42294782807052, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228, 11, 580, 6067, 1885, 11, 321, 279, 26957, 15532, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 274, 40101, 4396, 276, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 2414, 10255, 279, 8858, 314, 780, 7662, 13, 1049, 557, 524, 264, 6730, 11, 6130, 264, 6365, 314, 32524, 6451, 13, 1049, 557, 264, 2682, 390, 314, 5983, 8720, 11, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 3043, 279, 2255, 314, 279, 41586, 13, 271, 36, 69388, 23928, 424, 440, 279, 26926, 314, 264, 855, 852, 995, 3753, 2166, 1599, 14457, 2433, 11041, 685, 383, 780, 29199, 13, 1216, 41600, 424, 680, 440, 780, 10146, 13, 1049, 557, 264, 16002, 11, 11702, 2543, 4583, 321, 6121, 5983, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 16829, 440, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 91824, 470, 13, 357, 1876, 303, 264, 16002, 13, 271, 1465, 6316, 424, 888, 303, 780, 5888, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 279, 8720, 11, 8981, 321, 47966, 13, 26482, 11, 21748, 37679, 11, 557, 264, 20485, 314, 5392, 13, 271, 36, 69388, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 2545, 10281, 1056, 13087, 13, 1216, 8826, 279, 16002, 383, 279, 8545, 36620, 1898, 303, 279, 9488, 11, 1332, 279, 3000, 494, 279, 5415, 27056, 6113, 1248, 11, 27060, 33367, 13, 1216, 7338, 364], "info": "DONE 512 33 250.3 6137.4 length 257 438 0 398394 405212 0 0 0.0 33 83 chunk=0 experts_streamed=0", "sha": "f8746ccbd57d6649", "gpu": {"0": {"util": 76.8, "power_w": 132.0, "n": 32}, "1": {"util": 69.1, "power_w": 133.9, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 103.03054694731759, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 78951, 13126, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 19846, 25, 198, 12, 53019, 391, 52589, 1103, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 3140, 3110, 506, 9495, 8, 198, 12, 6328, 2336, 5529, 496, 7, 16, 8, 1328, 4534, 37761, 18054, 198, 12, 11396, 615, 363, 321, 2113, 363, 14061, 303, 496, 7, 16, 8, 854, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 220, 653, 20098, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 3110, 8, 198, 285, 638, 4381, 283, 2168, 220, 653, 20098, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 3110, 8, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 14963, 5759, 25, 198, 262, 471, 1901, 64575, 2423, 64575, 9495, 220, 318, 67, 5309, 391, 52589, 1103, 8, 198, 406, 1901, 283, 1379, 5742, 1429, 198, 406, 9495, 283, 3140, 5742, 1429, 198, 262, 471, 6297, 25, 6249, 12366, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 506, 22005, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 16782, 9495, 198, 285, 653, 2302, 2496, 3222, 1865, 795, 694, 38406], "info": "DONE 512 36 239.2 4969.4 length 320 454 0 339228 354201 0 0 0.0 36 1426 chunk=0 experts_streamed=0", "sha": "1610e3a8b9388710", "gpu": {"0": {"util": 80.0, "power_w": 130.6, "n": 26}, "1": {"util": 74.6, "power_w": 134.7, "n": 26}}}, {"kind": "facts", "gen": 476, "tok_s": 95.0972949214848, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 1942, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 476 37 333.0 5005.4 stop 299 443 0 323571 343843 0 0 0.0 37 2207 chunk=0 experts_streamed=0", "sha": "651d15a182f97816", "gpu": {"0": {"util": 80.4, "power_w": 130.9, "n": 27}, "1": {"util": 79.3, "power_w": 132.5, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1651.0668276972624, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9936.0 140.6 length 4 4 0 2796 3746 0 0 0.0 16405 182 chunk=8192 experts_streamed=36556", "tok_s": null, "gpu": {"0": {"util": 66.2, "power_w": 110.5, "n": 50}, "1": {"util": 59.9, "power_w": 110.7, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2895.005932685722, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 20732.6 120.9 length 4 4 16384 3526 4294 0 0 0.0 43637 122 chunk=8192 experts_streamed=103608", "tok_s": null, "gpu": {"0": {"util": 74.9, "power_w": 119.8, "n": 104}, "1": {"util": 80.7, "power_w": 121.5, "n": 104}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 4, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.12761861987104, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 11, 430, 413, 279, 8529, 998, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279], "info": "DONE 512 33 314.7 6234.2 length 258 456 0 328541 334935 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "91affce38e3f51ca", "gpu": {"0": {"util": 44.6, "power_w": 122.7, "n": 33}, "1": {"util": 53.3, "power_w": 128.7, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 98.72163199197887, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 364, 496, 7, 16, 8, 311, 50123, 321, 264, 5010, 2336, 364, 496, 7, 16, 8, 1353, 8339, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 3555, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 220, 653, 20098, 310, 279, 3555, 2357, 318, 83, 79141, 436, 34810, 809, 8, 198, 285, 638, 4381, 283, 2168, 220, 653, 20098, 310, 279, 1727, 2357, 318, 83, 79141, 27412, 52, 809, 8, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 198, 406, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 406, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 271, 262, 1848, 359, 447, 1170, 3166, 23975, 2357, 310, 27412, 52, 2234, 13, 198, 262, 1848, 359, 611, 1170, 5479, 28856, 2357, 506, 27412, 52, 2234, 26, 3514, 823, 436, 34810, 2357, 413, 888, 8390, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 38406, 6607, 37208, 11256, 318, 2083, 2168, 11988, 364, 1901, 5350, 589, 8, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 48864, 1901, 318, 17896, 52, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 48864, 9495, 318, 19504, 52, 3008, 8], "info": "DONE 512 36 293.0 5186.3 length 336 433 0 269867 282750 0 0 0.0 36 1381 chunk=0 experts_streamed=0", "sha": "e459b6708f3bfdc6", "gpu": {"0": {"util": 45.4, "power_w": 121.0, "n": 28}, "1": {"util": 57.9, "power_w": 127.6, "n": 28}}}, {"kind": "facts", "gen": 490, "tok_s": 92.04989480012023, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 1007, 303, 279, 12570, 1785, 11, 25720, 449, 25659, 2094, 279, 7806, 303, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 490 37 391.3 5323.2 stop 315 448 0 270491 286700 0 0 0.0 37 1708 chunk=0 experts_streamed=0", "sha": "3ca0a27e58fb6bf0", "gpu": {"0": {"util": 44.8, "power_w": 118.7, "n": 28}, "1": {"util": 59.8, "power_w": 126.2, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.8072718511899, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9961.7 134.2 length 4 4 0 2590 3368 0 0 0.0 16405 145 chunk=8192 experts_streamed=35934", "tok_s": null, "gpu": {"0": {"util": 57.4, "power_w": 108.7, "n": 51}, "1": {"util": 62.2, "power_w": 110.8, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2957.427937915743, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20295.0 143.8 length 3 4 16384 3375 3946 0 0 0.0 43637 57 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.0, "power_w": 120.3, "n": 102}, "1": {"util": 77.9, "power_w": 123.0, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "overlap", "slots": "7342", "notes": ["strata serve: layer split: layers 0-24 (CUDA0), 25-47 (CUDA1), one hand-off per window (overlapped: STRATA_SPLIT_OVERLAP=1)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.6547852574837, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 5415, 84922, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 27044, 440, 2919, 321, 8106, 2414, 745, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 44104, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 30581, 77591, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 1898, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279], "info": "DONE 512 33 314.2 6270.3 length 255 452 0 328048 334421 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "a7c0955cb848bbab", "gpu": {"0": {"util": 44.3, "power_w": 120.1, "n": 33}, "1": {"util": 95.6, "power_w": 129.2, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 100.31347962382445, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 9495, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 7261, 5742, 1429, 3008, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 87401, 5742, 1429, 3008, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285, 7624, 4922, 283], "info": "DONE 512 36 289.6 5104.0 length 345 452 0 273451 286960 0 0 0.0 36 1500 chunk=0 experts_streamed=0", "sha": "ce5578741a2f7c1a", "gpu": {"0": {"util": 44.1, "power_w": 120.3, "n": 27}, "1": {"util": 93.2, "power_w": 127.0, "n": 27}}}, {"kind": "facts", "gen": 493, "tok_s": 92.43634454569319, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 12784, 364, 888, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 493 37 387.4 5333.4 stop 317 435 0 264284 281230 0 0 0.0 37 1886 chunk=0 experts_streamed=0", "sha": "93bd65cacaf3e3de", "gpu": {"0": {"util": 45.5, "power_w": 118.1, "n": 29}, "1": {"util": 93.9, "power_w": 125.9, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1647.9652827307702, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9954.7 137.6 length 4 4 0 2505 3341 0 0 0.0 16405 151 chunk=8192 experts_streamed=35932", "tok_s": null, "gpu": {"0": {"util": 54.4, "power_w": 109.8, "n": 50}, "1": {"util": 68.4, "power_w": 109.4, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2954.298230502301, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20316.5 152.1 length 4 5 16384 3669 4348 0 0 0.0 43637 87 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 66.5, "power_w": 118.9, "n": 103}, "1": {"util": 80.4, "power_w": 123.1, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "pw2", "slots": "7156", "notes": ["strata generate: note: --pipeline-windows 2 on a layer split of two stages without the draft layer on the first card (STRATA_MTP_STAGE0=1 asks for it): the draft chain then shares the last card with its window and the pipeline lost to the serial loop on 2x R9700 before 0.1.44 (docs/MULTI_GPU.md); kept as asked, --pipeline-windows 0 turns it off", "strata generate: --pipeline-windows 2: 278 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.4901720693433, "ids": [760, 29262, 506, 5068, 6451, 4963, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 14555, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 780, 20618, 14217, 13, 2332, 50614, 36165, 11, 780, 5888, 998, 10841, 13640, 314, 1562, 4623, 11, 780, 6574, 8831, 290, 310, 279, 10124, 314, 2235, 17032, 11, 321, 780, 6213, 279, 1829, 314, 279, 9117, 383, 264, 13071, 88, 1834, 2218, 33426, 11, 5365, 11, 321, 58256, 470, 13, 1216, 995, 8341, 279, 3000, 364, 25292, 1578, 13, 733, 421, 854, 11, 551, 995, 3753, 17199, 1387, 2272, 279, 22317, 11, 551, 995, 3753, 42046, 17052, 279, 14693, 974, 279, 51624, 725, 44104, 11, 321, 551, 995, 3753, 279, 6797, 9704, 303, 7736, 421, 874, 28520, 1362, 11969, 13, 1921, 551, 995, 2496, 3753, 3977, 4847, 1040, 279, 16002, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 11, 279, 2993, 314, 1834, 1332, 279, 12515, 321, 279, 9117, 9047, 310, 10562, 1083, 264, 3074, 11, 19177, 715, 13, 82697, 557, 11107, 279, 94682, 11, 264, 26305, 551, 10345, 1396, 6353, 310, 1716, 364, 32871, 421, 2493, 272, 813, 279, 55566, 11407, 466, 11, 777, 22103, 11, 310, 1353, 364, 11590, 314, 2199, 13, 561, 40554, 557, 3238, 11, 44431, 279, 25888, 3438, 17299, 314, 279, 67673, 13, 271, 1465, 28588, 424, 4139, 1402, 322, 1086, 303, 264, 10582, 314, 580, 1222, 11, 3043, 279, 2255, 314, 279, 17631, 16106, 1816, 13, 1049, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 4047, 8720, 28628, 13, 1049, 557, 264, 16002, 314, 6121, 11, 32709, 3045, 6105, 8720, 11, 18473, 440, 34830, 421, 995, 68342, 1083, 264, 3565, 11, 39943, 46912, 13, 1049, 6749, 13437, 11, 680, 314, 1925, 4082, 279, 6278, 3283, 971, 350, 314, 19340, 50692, 321, 11840, 25534, 421, 5802, 37302, 290, 279, 29199, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 13, 561, 8720, 557, 8981, 11, 47966, 440, 63993, 932, 13, 1216, 6316, 424, 888, 303, 780, 5888, 11, 36586, 279, 24544, 13, 561, 34830, 557, 41423, 11, 694, 33295, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 279, 10558, 11, 6121, 15196, 314, 279, 8720, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 13, 561, 3626, 557, 2526, 11, 264, 3074, 2956, 440, 264, 42558, 11, 264, 45996, 11, 321, 34044, 30265, 440, 6265, 551, 995, 1301, 748, 1599, 2942, 279, 947, 1489, 998, 15218, 10431, 13, 1216, 7338, 1441, 11, 35556, 506, 279, 16002, 13, 357, 14457, 5992, 507, 85646, 806, 506, 279, 1142, 314, 780, 12603, 13, 1049, 6273, 1040, 449, 78252, 11, 264, 19333, 314, 279, 95041, 551, 995, 63836, 364, 10476, 13, 271], "info": "DONE 512 33 252.6 6206.8 length 257 447 0 398050 405144 0 0 0.0 33 130 chunk=0 experts_streamed=0", "sha": "5d3afb4f401a5167", "gpu": {"0": {"util": 67.3, "power_w": 129.8, "n": 32}, "1": {"util": 76.1, "power_w": 134.1, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 103.66470945535534, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 2, 51301, 220, 16, 25, 11747, 51425, 318, 29292, 291, 8, 198, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 1005, 43072, 5287, 1714, 52560, 13061, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 1608, 12654, 579, 51425, 13, 271, 262, 51425, 30941, 34736, 1906, 13, 1165, 958, 3166, 2270, 6018, 363, 310, 198, 262, 1804, 449, 1455, 430, 328, 45085, 391, 1429, 1, 321, 2341, 1163, 22634, 5433, 8, 310, 3514, 823, 198, 262, 279, 3140, 5742, 1429, 1455, 13, 271, 262, 3984, 68230, 25, 198, 285, 471, 615, 25, 220, 496, 7, 16, 8, 198, 285, 471, 2113, 25, 220, 496, 7, 16, 8, 198, 262, 11156, 68230, 25, 198, 285, 471, 496, 49657, 3883, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 198, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 51425, 363, 220, 653, 1328, 1411, 869, 11, 11128, 539, 10121, 271, 262, 687, 615, 1153, 11, 1328, 25, 514, 8, 1411, 514, 25, 198, 285, 4071, 198, 285, 30523, 279, 869, 364, 279, 2574, 1328, 13, 271, 285, 1368, 279, 1328, 6513, 11, 424, 369, 7481, 310, 279, 809, 318, 3444, 5742, 1429, 553, 198, 285, 1368, 279, 1328, 1503, 524, 2905, 11, 460, 471, 16, 13, 271, 285, 17167, 25, 198, 309, 1328, 25, 561, 1328, 310, 1353, 685, 13, 271, 285, 5019, 25, 198, 309, 561, 19954, 869, 413, 1669, 11, 5752, 471, 16, 13, 198, 285, 4071, 198, 285, 413, 1328, 524, 303, 638, 19474, 25, 198, 309, 460, 471, 16, 198, 285, 653, 14142, 279, 23975, 1328, 310, 279, 809, 318, 3854, 430, 1379, 5742, 1429, 8, 198, 285, 638, 19474, 13242, 2270, 6018, 4702, 8, 198, 285, 460, 638, 19474, 7900, 60, 271, 262, 687, 2113, 1153, 11, 1328, 25, 514, 11, 869, 25, 514], "info": "DONE 512 36 242.2 4939.0 length 327 464 0 324573 343998 0 0 0.0 36 2018 chunk=0 experts_streamed=0", "sha": "7864b18b1743b35f", "gpu": {"0": {"util": 66.8, "power_w": 128.3, "n": 26}, "1": {"util": 85.6, "power_w": 134.1, "n": 26}}}, {"kind": "facts", "gen": 493, "tok_s": 94.7147989471864, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 8252, 3605, 22573, 11, 264, 14120, 13071, 7875, 1056, 8964, 421, 682, 51216, 364, 22892, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 682, 279, 1379, 77396, 314, 866, 11247, 11, 440, 220, 24, 20, 10457, 5629, 45052, 430, 314, 220, 17, 15, 17, 18, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 493 37 354.6 5205.1 stop 306 447 0 329321 351055 0 0 0.0 37 2356 chunk=0 experts_streamed=0", "sha": "a62ee2740f43ea2c", "gpu": {"0": {"util": 70.5, "power_w": 129.1, "n": 28}, "1": {"util": 79.8, "power_w": 132.0, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1651.3327427927202, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9934.4 149.3 length 4 4 0 2601 3672 0 0 0.0 16405 220 chunk=8192 experts_streamed=36557", "tok_s": null, "gpu": {"0": {"util": 61.0, "power_w": 110.2, "n": 50}, "1": {"util": 59.7, "power_w": 109.7, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2963.4292654747974, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20253.9 161.4 length 4 6 16384 3911 4912 0 0 0.0 43637 142 chunk=8192 experts_streamed=103608", "tok_s": null, "gpu": {"0": {"util": 78.8, "power_w": 120.0, "n": 103}, "1": {"util": 76.3, "power_w": 123.4, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.89641383281615, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 11, 430, 413, 279, 8529, 995, 21681, 1083, 279, 5445, 1040, 56084, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532], "info": "DONE 512 33 313.6 6251.8 length 256 460 0 330840 337259 0 0 0.0 33 121 chunk=0 experts_streamed=0", "sha": "319224671fa473ab", "gpu": {"0": {"util": 44.9, "power_w": 121.6, "n": 33}, "1": {"util": 59.5, "power_w": 129.2, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 100.49462196749627, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 318, 3444, 3110, 553, 198, 262, 471, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 198, 406, 3514, 29015, 279, 9495, 2357, 318, 53415, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 6572, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11], "info": "DONE 512 36 293.1 5094.8 length 338 441 0 271247 284043 0 0 0.0 36 1440 chunk=0 experts_streamed=0", "sha": "0870af28e4f17ebe", "gpu": {"0": {"util": 42.8, "power_w": 119.3, "n": 27}, "1": {"util": 58.2, "power_w": 125.7, "n": 27}}}, {"kind": "facts", "gen": 491, "tok_s": 96.10303184513906, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 491 37 381.8 5109.1 stop 319 425 0 259366 274731 0 0 0.0 37 1525 chunk=0 experts_streamed=0", "sha": "9ae6882d593b88b5", "gpu": {"0": {"util": 46.1, "power_w": 117.4, "n": 27}, "1": {"util": 58.0, "power_w": 124.9, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1650.5684676526812, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9939.0 138.7 length 4 4 0 2461 3312 0 0 0.0 16405 172 chunk=8192 experts_streamed=35960", "tok_s": null, "gpu": {"0": {"util": 63.6, "power_w": 109.0, "n": 51}, "1": {"util": 58.3, "power_w": 109.4, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2962.5077738620544, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20260.2 158.0 length 4 5 16384 3554 4307 0 0 0.0 43637 108 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 76.6, "power_w": 119.9, "n": 102}, "1": {"util": 75.8, "power_w": 122.9, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1-single/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1-single/summary.txt
new file mode 100644
index 000000000..aff449b8e
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1-single/summary.txt
@@ -0,0 +1,54 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | story:tok_s | 82.13 | 1.000 | 0/5 | 5
+overlap | story:tok_s | 82.35 | 1.003 | 2/5 | 5
+pw2 | story:tok_s | 81.30 | 0.990 | 2/5 | 5
+default2 | story:tok_s | 82.06 | 0.999 | 2/5 | 5
+default | code:tok_s | 97.76 | 1.000 | 0/5 | 5
+overlap | code:tok_s | 99.83 | 1.021 | 4/5 | 5
+pw2 | code:tok_s | 103.03 | 1.054 | 5/5 | 5
+default2 | code:tok_s | 100.49 | 1.028 | 5/5 | 5
+default | facts:tok_s | 93.63 | 1.000 | 0/5 | 5
+overlap | facts:tok_s | 93.38 | 0.997 | 2/5 | 5
+pw2 | facts:tok_s | 94.76 | 1.012 | 4/5 | 5
+default2 | facts:tok_s | 93.64 | 1.000 | 3/5 | 5
+default | pp16k:pp_tok_s | 1646.81 | 1.000 | 0/5 | 5
+overlap | pp16k:pp_tok_s | 1648.59 | 1.001 | 4/5 | 5
+pw2 | pp16k:pp_tok_s | 1651.33 | 1.003 | 4/5 | 5
+default2 | pp16k:pp_tok_s | 1647.27 | 1.000 | 3/5 | 5
+default | pp58k:pp_tok_s | 2956.07 | 1.000 | 0/5 | 5
+overlap | pp58k:pp_tok_s | 2958.62 | 1.001 | 3/5 | 5
+pw2 | pp58k:pp_tok_s | 2963.43 | 1.002 | 4/5 | 5
+default2 | pp58k:pp_tok_s | 2960.39 | 1.001 | 4/5 | 5
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | story | gpu0 45, gpu1 58 | 122, 129 | 49
+default | code | gpu0 45, gpu1 58 | 121, 127 | 49
+default | facts | gpu0 44, gpu1 61 | 119, 126 | 47
+default | pp16k | gpu0 55, gpu1 61 | 109, 109 | 42
+default | pp58k | gpu0 75, gpu1 78 | 120, 123 | 24
+overlap | story | gpu0 45, gpu1 94 | 121, 129 | 31
+overlap | code | gpu0 45, gpu1 94 | 120, 127 | 31
+overlap | facts | gpu0 45, gpu1 94 | 118, 126 | 30
+overlap | pp16k | gpu0 55, gpu1 65 | 109, 110 | 40
+overlap | pp58k | gpu0 77, gpu1 80 | 120, 123 | 21
+pw2 | story | gpu0 76, gpu1 75 | 132, 134 | 25
+pw2 | code | gpu0 73, gpu1 75 | 131, 134 | 26
+pw2 | facts | gpu0 71, gpu1 78 | 130, 132 | 26
+pw2 | pp16k | gpu0 58, gpu1 60 | 110, 110 | 41
+pw2 | pp58k | gpu0 76, gpu1 80 | 120, 123 | 22
+default2 | story | gpu0 45, gpu1 58 | 122, 128 | 48
+default2 | code | gpu0 45, gpu1 58 | 120, 126 | 48
+default2 | facts | gpu0 46, gpu1 59 | 118, 125 | 48
+default2 | pp16k | gpu0 58, gpu1 62 | 109, 109 | 40
+default2 | pp58k | gpu0 76, gpu1 78 | 120, 123 | 23
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+story: 14 distinct -> 1c01746bd4aa8c79:default; 008dccf84b36532a:default,default2,overlap; 8fbd675f2b34b5e3:pw2; 2fa43bd4ebb13cd1:pw2; afd22e324d2d9940:default2; d43b672bf7be1cb1:pw2; 31d88ac82bdf6ae5:overlap; da12ccce0593f5b4:default,default2; 15ebcf29b5162678:overlap; f8746ccbd57d6649:pw2; 91affce38e3f51ca:default; a7c0955cb848bbab:overlap; 5d3afb4f401a5167:pw2; 319224671fa473ab:default2
+code: 19 distinct -> 4b313919e85e39b4:default; a7e4a1c48e84b906:default2,overlap; 14d88a4c13be63b7:pw2; 7ce67910a72be85f:default2; bc30fe07ca8e50d3:overlap; 66fa0cc96f94efbd:pw2; 15610d42ccbd81d7:default2; 612774bf7ff21027:default; e4171b7711cde5ce:pw2; ec801efea1254ee8:default2; 290d5f1bd43f06cb:default; f5b67e456277df81:overlap; 7dd92589ace9f811:default; 45f9ca588c8a6dc8:overlap; 1610e3a8b9388710:pw2; e459b6708f3bfdc6:default; ce5578741a2f7c1a:overlap; 7864b18b1743b35f:pw2; 0870af28e4f17ebe:default2
+facts: 18 distinct -> d02ccf8df3989951:default; c229bdca374702de:overlap; 51ba6909cd7a9706:pw2; aeff37ca994e506e:default2; 5c9a13ac44c56caa:overlap; c6f93065d8f41796:pw2; c5fb683f831e986e:default2; cb02e14bcab3e033:default,overlap; 3ca0a27e58fb6bf0:default,pw2; c969965f64b1c703:default2; f4024f42ed689588:default; 8930a996a572e8b6:default2; e52c6aa7891fc91b:default; c28d387b00ba4408:overlap; 651d15a182f97816:pw2; 93bd65cacaf3e3de:overlap; a62ee2740f43ea2c:pw2; 9ae6882d593b88b5:default2
+pp16k: 1 distinct
+pp58k: 2 distinct -> 84d46cd5a99fc0a9:default,default2,overlap,pw2; 56ca29a619f7cd8d:default,overlap,pw2
+default: expert-cache slots ['7342']
+overlap: expert-cache slots ['7342']
+pw2: expert-cache slots ['7156']
+default2: expert-cache slots ['7342']
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1b-single/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1b-single/results.jsonl
new file mode 100644
index 000000000..214026ae8
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1b-single/results.jsonl
@@ -0,0 +1,20 @@
+{"round": 0, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.18298555377207, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 27373, 8545, 11, 21861, 279, 8529, 998, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874], "info": "DONE 512 33 311.2 6230.0 length 258 461 0 330973 337337 0 0 0.0 33 118 chunk=0 experts_streamed=0", "sha": "1411a2a700d145ff", "gpu": {"0": {"util": 45.0, "power_w": 119.1, "n": 33}, "1": {"util": 58.5, "power_w": 128.9, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 98.5525100092393, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 2, 51301, 220, 16, 25, 11747, 51425, 318, 29292, 291, 8, 198, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 1005, 43072, 5287, 1714, 52560, 13061, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 1608, 12654, 579, 51425, 13, 271, 262, 51425, 30941, 34736, 1906, 13, 1165, 958, 3166, 2270, 6018, 363, 310, 198, 262, 1804, 449, 1455, 430, 328, 45085, 391, 1429, 1, 321, 2341, 1163, 22634, 5433, 8, 310, 3514, 823, 198, 262, 279, 3140, 5742, 1429, 1455, 13, 271, 262, 3984, 68230, 25, 198, 285, 471, 615, 25, 220, 496, 7, 16, 8, 198, 285, 471, 2113, 25, 220, 496, 7, 16, 8, 198, 262, 11156, 68230, 25, 496, 49657, 3883, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 198, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 51425, 363, 220, 653, 1328, 1411, 869, 11, 11128, 539, 10121, 271, 262, 687, 615, 1153, 11, 1328, 1590, 198, 285, 4071, 198, 285, 30523, 279, 869, 364, 279, 2574, 1328, 13, 271, 285, 1368, 279, 1328, 6513, 11, 424, 369, 7481, 310, 279, 809, 318, 44816, 430, 5742, 1429, 553, 198, 285, 1368, 279, 1328, 1503, 524, 2905, 11, 460, 471, 16, 13, 271, 285, 17167, 25, 198, 309, 1328, 25, 561, 1328, 310, 1353, 685, 13, 271, 285, 5019, 25, 198, 309, 561, 19954, 869, 413, 1669, 11, 5752, 471, 16, 13, 198, 285, 4071, 198, 285, 413, 1328, 524, 303, 638, 19474, 25, 198, 309, 460, 471, 16, 198, 285, 653, 14142, 279, 23975, 1328, 310, 279, 809, 318, 3444, 5742, 1429, 8, 198, 285, 638, 19474, 13242, 2270, 6018, 4702, 8, 198, 285, 460, 638, 19474, 7900, 60, 271, 262, 687, 2113, 1153, 11, 1328, 11, 869, 1590, 198, 285], "info": "DONE 512 36 289.7 5195.2 length 337 438 0 268904 283322 0 0 0.0 36 1455 chunk=0 experts_streamed=0", "sha": "14d88a4c13be63b7", "gpu": {"0": {"util": 42.3, "power_w": 119.2, "n": 27}, "1": {"util": 59.3, "power_w": 127.3, "n": 27}}}, {"kind": "facts", "gen": 494, "tok_s": 93.58010191517172, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 494 37 400.6 5278.9 stop 318 439 0 265679 282673 0 0 0.0 37 1825 chunk=0 experts_streamed=0", "sha": "1f49d91321c78079", "gpu": {"0": {"util": 46.9, "power_w": 117.3, "n": 29}, "1": {"util": 60.6, "power_w": 126.3, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1664.552787783471, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9855.5 136.2 length 4 4 0 2495 3329 0 0 0.0 16405 157 chunk=8192 experts_streamed=35900", "tok_s": null, "gpu": {"0": {"util": 60.1, "power_w": 101.6, "n": 50}, "1": {"util": 60.0, "power_w": 98.8, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2982.7952928080144, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20122.4 152.6 length 4 5 16384 3618 4324 0 0 0.0 43637 92 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 77.0, "power_w": 119.8, "n": 101}, "1": {"util": 75.9, "power_w": 122.4, "n": 101}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "pw2s0", "slots": "6594", "notes": ["strata generate: --pipeline-windows 2: 272 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 71.62742546970523, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 4396, 276, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 324, 55965, 2255, 11, 12910, 364, 23016, 5383, 11, 948, 551, 5312, 424, 13, 1049, 557, 524, 264, 8026, 11, 6130, 264, 6365, 314, 32524, 6451, 11, 694, 2414, 2526, 11, 85624, 303, 279, 1819, 1706, 314, 279, 22317, 3043, 279, 40554, 1500, 13, 271, 1465, 23928, 88239, 13, 561, 1576, 557, 264, 16002, 11, 18473, 440, 34830, 321, 86249, 11, 4139, 1402, 322, 1086, 303, 279, 9002, 13, 1049, 557, 524, 6278, 11840, 11, 694, 11702, 11, 5983, 8720, 11, 279, 2993, 1429, 364, 12701, 466, 29638, 303, 279, 3555, 9018, 13, 561, 2306, 557, 1248, 7795, 11, 53798, 539, 279, 11679, 12615, 11, 694, 279, 5893, 557, 91824, 470, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 975, 1056, 2919, 13, 1216, 33757, 424, 28314, 13, 357, 8153, 22353, 2631, 4950, 3571, 494, 2785, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 70676, 2956, 11, 279, 2172, 17796, 44102, 13569, 11, 23414, 1141, 22690, 680, 1083, 279, 715, 13, 82697, 8826, 279, 16002, 383, 780, 944, 26157, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 13, 1216, 23354, 279, 34830, 24544, 13, 1049, 557, 33503, 11, 1375, 2195, 19772, 11, 440, 264, 41182, 16810, 1083, 279, 3008, 13, 1049, 6749, 2235, 11, 694, 524, 13437, 13, 18200, 31347, 1578, 30, 18117, 1816, 30, 271, 2278, 264, 2526, 20773, 11, 551, 15060, 509, 6248, 3023, 279, 34830, 13, 561, 86249, 64077, 11, 72536, 440, 30137], "info": "DONE 512 33 267.0 7148.1 length 249 442 0 404234 411548 0 0 0.0 33 132 chunk=0 experts_streamed=0", "sha": "1b105ccf96e69ba0", "gpu": {"0": {"util": 78.1, "power_w": 134.2, "n": 37}, "1": {"util": 48.3, "power_w": 119.8, "n": 37}}}, {"kind": "code", "gen": 512, "tok_s": 94.4562309750023, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 1919, 7873, 79744, 496, 7, 16, 8, 854, 22373, 364, 2107, 615, 321, 2113, 7289, 198, 940, 264, 10286, 314, 264, 5010, 2336, 321, 264, 90651, 52589, 1103, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 16, 25, 5829, 3124, 318, 1891, 11048, 90651, 52589, 1103, 5313, 8, 198, 2, 15692, 10089, 198, 1005, 5829, 25, 198, 262, 4071, 198, 262, 37606, 264, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 1031, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 436, 34810, 809, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 1031, 262, 561, 10278, 1103, 30941, 1906, 25, 198, 262, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 262, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 17, 25, 436, 34810, 18887, 3124, 318, 50342, 29806, 440, 53019, 391, 12, 21390, 1697, 8, 198, 2, 15692, 10089, 198, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 1031, 262, 2791, 67678, 25, 198, 262, 471, 638, 19474, 25, 6249, 12366, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 638, 15569, 25, 16782, 1901, 2357, 318, 17896, 52, 3008, 8, 198, 262, 471, 638, 37429, 25, 16782, 9495, 2357, 318, 19504, 52, 3008, 8, 198, 262, 471, 638, 57167, 25, 6966, 1324, 314, 3470, 303, 279, 6297, 198, 262, 471, 638, 2406, 25, 1428, 1324, 314, 3470, 303, 279, 6297, 6987, 262, 12734, 1697, 13425, 25, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 6987, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 4523, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 27412, 52, 2234, 11, 745, 471, 16, 198, 262, 471, 2113, 4702, 11, 869, 1590, 47640, 14], "info": "DONE 512 36 249.3 5420.5 length 317 472 0 347197 362288 0 0 0.0 36 1354 chunk=0 experts_streamed=0", "sha": "c42a369374eb8e8b", "gpu": {"0": {"util": 91.7, "power_w": 136.0, "n": 28}, "1": {"util": 58.5, "power_w": 120.3, "n": 28}}}, {"kind": "facts", "gen": 384, "tok_s": 89.62121035311691, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 77396, 321, 874, 16078, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 318, 2054, 298, 6721, 12331, 553, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 1330, 2526, 77396, 6725, 2274, 656, 428, 321, 1526, 23352, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 10457, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 53915, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 13, 198, 16, 17, 13, 47503, 682, 506, 3140, 220, 16, 19, 21, 10457, 77396, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 220, 16, 19, 3750, 77396, 13, 198, 16, 22, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 23672, 717, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 31784, 303, 279, 23672, 717, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 24, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 13071, 7875, 1056, 8964, 11, 12805, 220, 16, 21, 11, 15, 15, 15, 12754, 6669, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 1007, 303, 279, 23672, 717, 506, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 384 37 347.4 4284.7 stop 242 367 0 257553 273727 0 0 0.0 37 1675 chunk=0 experts_streamed=0", "sha": "cb82ba092887d71a", "gpu": {"0": {"util": 90.3, "power_w": 133.7, "n": 23}, "1": {"util": 65.5, "power_w": 120.0, "n": 23}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1597.308770836579, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 10270.4 155.2 length 4 4 0 2963 3960 0 0 0.0 16405 184 chunk=8192 experts_streamed=36823", "tok_s": null, "gpu": {"0": {"util": 53.8, "power_w": 111.0, "n": 52}, "1": {"util": 68.7, "power_w": 106.2, "n": 52}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2834.7762018787994, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 21173.1 154.5 length 3 5 16384 4175 4981 0 0 0.0 43637 89 chunk=8192 experts_streamed=104532", "tok_s": null, "gpu": {"0": {"util": 75.0, "power_w": 120.4, "n": 107}, "1": {"util": 73.7, "power_w": 120.3, "n": 107}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "pw1", "slots": "7238", "notes": ["strata generate: --pipeline-windows 1: 160 MiB of CUDA0 kept out of the expert cache (the second verifier)", "strata serve: --pipeline-windows 1: two verifiers per stage, 2 stages overlap across windows"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.59752657497569, "ids": [760, 29262, 506, 5068, 6451, 4963, 1467, 524, 15756, 38225, 26, 424, 61551, 13, 1049, 61199, 279, 32946, 11, 279, 9117, 11, 321, 279, 12515, 11, 9101, 1132, 279, 27163, 20569, 11, 21461, 50355, 314, 279, 324, 55965, 321, 279, 55218, 6851, 314, 82697, 645, 16413, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 6574, 557, 17032, 290, 539, 11679, 321, 9662, 11, 780, 5888, 10841, 430, 32524, 6451, 11, 321, 780, 6213, 279, 1829, 314, 279, 13071, 88, 21678, 13, 1216, 995, 8341, 279, 3000, 364, 25292, 1578, 11, 264, 37671, 748, 1248, 421, 279, 2136, 70704, 874, 4860, 5312, 1384, 430, 264, 1637, 11, 694, 430, 264, 4416, 314, 279, 17865, 11, 430, 14884, 321, 5689, 430, 279, 49577, 4924, 13, 271, 15514, 13618, 557, 264, 12647, 59452, 314, 95041, 13, 39235, 506, 220, 19, 25, 15, 15, 6556, 13, 4109, 279, 5415, 5684, 13, 30931, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 13, 12194, 279, 44798, 314, 279, 17507, 11, 13879, 364, 279, 10174, 276, 314, 279, 10679, 88663, 466, 279, 15268, 314, 264, 338, 602, 13, 4844, 11, 52736, 279, 39740, 59678, 11, 7923, 264, 16976, 314, 2503, 83, 463, 321, 3619, 10482, 11, 321, 3655, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 40613, 1029, 279, 12515, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 4570, 10994, 11, 264, 14590, 12931, 314, 542, 2104, 421, 10641, 1881, 279, 2255, 314, 279, 324, 55965, 321, 279, 509, 51554, 9117, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 14084, 314, 9002, 5802, 7920, 23221, 279, 16382, 13, 1216, 557, 3221, 364, 9117, 8720, 11, 264, 30490, 551, 995, 4284, 685, 303, 780, 2843, 1578, 310, 45993, 780, 3838, 2261, 279, 1248, 11, 20413, 20803, 13, 271, 1465, 5312, 424, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 11, 3043, 279, 25888, 3438, 17299, 314, 279, 22317, 13, 1049, 557, 524, 9117, 8720, 13, 1049, 557, 264, 16002, 13, 271, 2064, 557, 264, 6121, 5983, 8720, 25347, 11, 18473, 440, 34830, 421, 995, 41423, 694, 5467, 7239, 13, 1049, 557, 524, 6278, 13, 561, 5893, 557, 44286, 757, 11, 279, 12603, 1248, 321, 69787, 11, 13852, 314, 25534, 494, 279, 3200, 220, 16, 24, 337, 466, 3988, 220, 17, 15, 337, 9018, 13, 82697, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 975, 1056, 3594, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 13, 561, 10849, 324, 13178, 2272, 279, 10708, 11, 264, 57040, 22472, 5143, 421, 5802, 748, 8502, 290, 1384, 13, 10875, 11, 424, 33172, 1040, 264, 9663, 13, 271, 1465, 30673, 264, 20773, 888, 279, 42558, 2980, 279, 24052, 2682, 12449, 2438, 11, 1179, 15060, 47698, 279, 34830, 24544, 13, 561, 21388, 314, 2235, 1298, 2562, 258, 321, 1363, 472, 9896, 279, 2526, 2956, 13, 1216, 12854, 279, 86249, 13], "info": "DONE 512 33 245.3 6274.7 length 256 429 0 315208 322361 0 0 0.0 33 240 chunk=0 experts_streamed=0", "sha": "5fee251b62c70822", "gpu": {"0": {"util": 45.0, "power_w": 123.6, "n": 33}, "1": {"util": 58.5, "power_w": 131.6, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 98.73876653681491, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 9495, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 7261, 5742, 1429, 3008, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 87401, 5742, 1429, 3008, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285, 7624, 4922, 283], "info": "DONE 512 36 242.5 5185.4 length 343 449 0 271432 285783 0 0 0.0 36 1626 chunk=0 experts_streamed=0", "sha": "ce5578741a2f7c1a", "gpu": {"0": {"util": 42.4, "power_w": 121.1, "n": 27}, "1": {"util": 51.3, "power_w": 129.8, "n": 27}}}, {"kind": "facts", "gen": 467, "tok_s": 94.00350248595987, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 467 37 323.3 4967.9 stop 309 412 0 245346 262112 0 0 0.0 37 1803 chunk=0 experts_streamed=0", "sha": "a4f5aa2f602f4523", "gpu": {"0": {"util": 46.7, "power_w": 119.6, "n": 26}, "1": {"util": 62.3, "power_w": 125.3, "n": 26}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1645.8820342520041, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9967.3 137.8 length 4 4 0 2511 3335 0 0 0.0 16405 162 chunk=8192 experts_streamed=36403", "tok_s": null, "gpu": {"0": {"util": 57.6, "power_w": 108.6, "n": 51}, "1": {"util": 62.4, "power_w": 110.5, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2837.7247519041566, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 21151.1 155.9 length 4 5 16384 3668 4358 0 0 0.0 43637 82 chunk=8192 experts_streamed=103140", "tok_s": null, "gpu": {"0": {"util": 71.3, "power_w": 117.7, "n": 107}, "1": {"util": 74.5, "power_w": 120.3, "n": 107}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 0, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 80.57535841870859, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 5415, 84922, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 8799, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 314.4 6354.3 length 255 473 0 337195 343799 0 0 0.0 33 124 chunk=0 experts_streamed=0", "sha": "3ed28dd532e318fa", "gpu": {"0": {"util": 44.1, "power_w": 121.8, "n": 34}, "1": {"util": 60.9, "power_w": 127.7, "n": 34}}}, {"kind": "code", "gen": 512, "tok_s": 99.20173603038053, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1328, 18054, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 406, 471, 1328, 25, 279, 6297, 1328, 198, 406, 471, 869, 25, 279, 19954, 869, 198, 406, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 436, 34810, 809, 8, 198, 406, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 27412, 52, 809, 8, 271, 262, 561, 10278, 1103, 30941, 2528, 1906, 25, 198, 406, 1901, 64575, 2423, 64575, 9495, 198, 406, 318, 19504, 52, 8, 1779, 318, 17896, 52, 8, 198, 262, 4071, 198, 262, 1259, 48093, 548, 283, 4178, 767, 504, 359, 927, 504, 359, 9590, 504, 359, 3480, 837, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 11, 869, 25, 514, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 14963, 5759, 25, 198, 406, 471, 638, 19474, 25, 6249, 12366, 1328, 1411, 5829, 318, 1891, 496, 7, 16, 8, 18054, 8, 198, 406, 471, 638, 15569, 25, 16782, 1901, 2357, 318, 7462, 8574, 436, 34810, 3008, 8, 198, 406, 471, 638, 37429, 25, 16782, 9495, 2357, 318, 7462, 8574, 27412, 52, 3008, 8, 198, 406, 471, 638, 57167, 25, 6966, 1324, 314, 3470, 198, 406, 471, 638, 2406, 25, 1428, 1324, 314, 3470, 271, 262, 561, 90651, 52589, 1103, 1906, 25, 198, 406, 1901, 64575, 2357, 16, 64575, 2357, 17, 64575, 2423, 64575, 9495, 198, 406, 318, 19504, 52, 8, 4448, 318, 17896, 52, 8, 271, 262, 1848, 359, 447, 1170, 3166, 23975, 2357, 310, 279, 9495, 318, 17896, 52, 2234, 553, 198, 262, 1848, 359, 611, 1170, 5479, 491, 2357, 506, 9495, 26, 413, 888, 8390, 11, 3921, 1901, 4381, 318, 19504, 52, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308], "info": "DONE 512 36 295.9 5161.2 length 338 428 0 264557 278525 0 0 0.0 36 1512 chunk=0 experts_streamed=0", "sha": "7a858dbde4437279", "gpu": {"0": {"util": 45.3, "power_w": 120.6, "n": 27}, "1": {"util": 51.9, "power_w": 125.5, "n": 27}}}, {"kind": "facts", "gen": 479, "tok_s": 93.7212623999687, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 25, 28686, 11, 37222, 11, 47437, 1544, 14880, 11, 321, 6920, 24534, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 321, 1000, 2153, 303, 2919, 413, 264, 3349, 3213, 17415, 23533, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 440, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 7810, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 1942, 31784, 303, 279, 12570, 1785, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 430, 7246, 539, 94370, 579, 6657, 13, 248046], "info": "DONE 479 37 388.0 5110.9 stop 310 423 0 255086 271466 0 0 0.0 37 1686 chunk=0 experts_streamed=0", "sha": "1491bd4b6892fc12", "gpu": {"0": {"util": 43.3, "power_w": 119.8, "n": 27}, "1": {"util": 59.0, "power_w": 124.0, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1647.4026169650838, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9958.1 134.1 length 4 4 0 2591 3373 0 0 0.0 16405 132 chunk=8192 experts_streamed=35902", "tok_s": null, "gpu": {"0": {"util": 62.5, "power_w": 109.5, "n": 51}, "1": {"util": 53.6, "power_w": 110.5, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2960.155452424752, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20276.3 149.7 length 4 5 16384 3747 4382 0 0 0.0 43637 71 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 78.1, "power_w": 119.9, "n": 102}, "1": {"util": 79.0, "power_w": 123.6, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "pw2s0", "slots": "6594", "notes": ["strata generate: --pipeline-windows 2: 272 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 69.44915426664677, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 20413, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 5642, 4097, 1578, 4711, 11, 9101, 1384, 440, 4161, 694, 279, 3000, 321, 279, 24860, 11, 509, 51554, 9117, 13, 271, 2064, 557, 264, 7348, 303, 3200, 6324, 948, 279, 13071, 14009, 13, 1049, 5532, 1357, 264, 47059, 11, 694, 264, 15920, 11, 509, 51554, 1507, 28170, 421, 76911, 279, 20618, 364, 2250, 2756, 13, 561, 9662, 58330, 1472, 279, 53282, 29379, 82, 11, 264, 1496, 2195, 89211, 288, 589, 421, 16433, 639, 303, 82697, 725, 17299, 13, 561, 9117, 15537, 303, 3565, 22767, 11, 43957, 2272, 279, 2255, 314, 279, 324, 55965, 440, 279, 5176, 314, 51350, 13, 271, 1860, 279, 6353, 1238, 279, 13071, 11, 279, 3594, 557, 1990, 11702, 440, 279, 39029, 314, 73823, 321, 1363, 472, 13, 82697, 23562, 680, 8366, 279, 17507, 11, 279, 10679, 88663, 8981, 2272, 780, 72176, 13, 561, 9117, 557, 1564, 1134, 1381, 11, 694, 279, 32871, 2002, 557, 12401, 13, 2832, 2017, 6451, 11, 89644, 580, 1222, 11, 321, 279, 53507, 69883, 314, 19340, 50692, 37302, 290, 279, 53653, 29199, 3559, 13, 271, 36, 69388, 55807, 279, 39740, 30129, 11, 780, 24435, 90493, 303, 279, 40423, 20618, 11, 321, 14428, 1441, 279, 1752, 310, 279, 10994, 13, 1216, 557, 3221, 364, 5383, 310, 279, 15787, 11, 694, 430, 551, 45867, 279, 40554, 1500, 11, 2414, 10255, 780, 7662, 13, 1049, 5532, 1357, 32524, 6451, 13, 1049, 557, 264, 16002, 13, 271, 2064, 10641, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 11, 85624, 1881, 1330, 25888, 3438, 22317, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 34830, 421, 995, 41423, 694, 5467, 7239, 13, 561, 2306, 557, 1248, 7795, 11, 43407, 2634, 3023, 539, 279, 17415, 725, 28342, 13, 82697, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 6235, 13, 1216, 33757, 424, 28314, 13, 357, 8153, 348, 337, 643, 9, 33172, 494, 2785, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 13, 561, 2956, 557], "info": "DONE 512 33 267.8 7372.3 length 245 455 0 414908 422026 0 0 0.0 33 110 chunk=0 experts_streamed=0", "sha": "cdc6511981fd6e8c", "gpu": {"0": {"util": 77.2, "power_w": 134.3, "n": 38}, "1": {"util": 47.5, "power_w": 119.9, "n": 38}}}, {"kind": "code", "gen": 512, "tok_s": 96.12135320842563, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 2, 51301, 220, 16, 25, 11747, 51425, 318, 29292, 291, 8, 198, 2, 21910, 222, 54907, 54907, 54907, 54907, 54907, 31256, 14136, 198, 1005, 43072, 5287, 1714, 52560, 13061, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 1608, 12654, 579, 51425, 13, 271, 262, 51425, 30941, 34736, 1906, 13, 1165, 958, 3166, 2270, 6018, 363, 310, 198, 262, 1804, 449, 1455, 430, 328, 45085, 391, 1429, 1, 321, 2341, 1163, 22634, 5433, 8, 310, 3514, 823, 198, 262, 279, 3140, 5742, 1429, 1455, 13, 271, 262, 3984, 68230, 25, 198, 285, 471, 615, 25, 220, 496, 7, 16, 8, 198, 285, 471, 2113, 25, 220, 496, 7, 16, 8, 198, 262, 11156, 68230, 25, 496, 49657, 3883, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 6966, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 198, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 51425, 363, 220, 653, 1328, 1411, 869, 11, 11128, 539, 10121, 271, 262, 687, 615, 1153, 11, 1328, 1590, 198, 285, 4071, 198, 285, 30523, 279, 869, 364, 279, 2574, 1328, 13, 271, 285, 1368, 279, 1328, 6513, 11, 424, 369, 7481, 310, 279, 809, 318, 44816, 430, 5742, 1429, 553, 198, 285, 1368, 279, 1328, 1503, 524, 2905, 11, 460, 471, 16, 13, 271, 285, 17167, 25, 198, 309, 1328, 25, 561, 1328, 310, 1353, 685, 13, 271, 285, 5019, 25, 198, 309, 561, 19954, 869, 413, 1669, 11, 5752, 471, 16, 13, 198, 285, 4071, 198, 285, 413, 1328, 524, 303, 638, 19474, 25, 198, 309, 460, 471, 16, 198, 285, 653, 14142, 279, 23975, 1328, 310, 279, 809, 318, 3444, 5742, 1429, 8, 198, 285, 638, 19474, 13242, 2270, 6018, 4702, 8, 198, 285, 460, 638, 19474, 7900, 60, 271, 262, 687, 2113, 1153, 11, 1328, 11, 869, 1590, 198, 285], "info": "DONE 512 36 251.4 5326.6 length 322 456 0 330150 347606 0 0 0.0 36 1665 chunk=0 experts_streamed=0", "sha": "14d88a4c13be63b7", "gpu": {"0": {"util": 82.7, "power_w": 135.4, "n": 28}, "1": {"util": 55.4, "power_w": 119.9, "n": 28}}}, {"kind": "facts", "gen": 493, "tok_s": 87.19490626105413, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 93448, 47837, 11, 279, 78802, 63004, 303, 279, 12570, 1785, 506, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 12784, 364, 888, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 493 37 374.4 5654.0 stop 308 454 0 329418 351698 0 0 0.0 37 2479 chunk=0 experts_streamed=0", "sha": "1b8a5ad32ac6ee89", "gpu": {"0": {"util": 76.9, "power_w": 134.7, "n": 30}, "1": {"util": 64.3, "power_w": 119.9, "n": 30}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1594.0803793532336, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 10291.2 158.7 length 4 4 0 2656 3659 0 0 0.0 16405 197 chunk=8192 experts_streamed=36912", "tok_s": null, "gpu": {"0": {"util": 62.2, "power_w": 111.3, "n": 53}, "1": {"util": 67.8, "power_w": 106.6, "n": 53}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2790.0522951772223, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 21512.5 129.4 length 4 4 16384 3489 4242 0 0 0.0 43637 124 chunk=8192 experts_streamed=104532", "tok_s": null, "gpu": {"0": {"util": 64.9, "power_w": 120.1, "n": 108}, "1": {"util": 75.1, "power_w": 119.8, "n": 108}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 1, "arm": "pw1", "slots": "7238", "notes": ["strata generate: --pipeline-windows 1: 160 MiB of CUDA0 kept out of the expert cache (the second verifier)", "strata serve: --pipeline-windows 1: two verifiers per stage, 2 stages overlap across windows"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.09477952356816, "ids": [760, 29262, 506, 5068, 6451, 4963, 1467, 524, 15756, 38225, 26, 424, 61551, 13, 1049, 61199, 279, 32946, 11, 279, 9117, 11, 321, 279, 12515, 11, 9101, 1132, 279, 27163, 20569, 11, 21461, 50355, 314, 279, 324, 55965, 321, 279, 55218, 6851, 314, 82697, 645, 16413, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 6574, 557, 17032, 290, 539, 11679, 321, 9662, 11, 780, 5888, 10841, 430, 32524, 6451, 11, 321, 780, 6213, 279, 1829, 314, 279, 13071, 88, 21678, 13, 1216, 995, 8341, 279, 3000, 364, 25292, 1578, 11, 264, 37671, 748, 1248, 421, 279, 2136, 70704, 874, 4860, 5312, 1384, 430, 264, 1637, 11, 694, 430, 264, 4416, 314, 279, 17865, 11, 430, 14884, 321, 5689, 430, 279, 49577, 4924, 13, 271, 15514, 13618, 557, 264, 12647, 59452, 314, 95041, 13, 39235, 506, 220, 19, 25, 15, 15, 6556, 13, 4109, 279, 5415, 5684, 13, 30931, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 13, 12194, 279, 44798, 314, 279, 17507, 11, 13879, 364, 279, 10174, 276, 314, 279, 10679, 88663, 466, 279, 15268, 314, 264, 338, 602, 13, 4844, 11, 52736, 279, 39740, 59678, 11, 7923, 264, 16976, 314, 2503, 83, 463, 321, 3619, 10482, 11, 321, 3655, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 40613, 1029, 279, 12515, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 4570, 10994, 11, 264, 14590, 12931, 314, 542, 2104, 421, 10641, 1881, 279, 2255, 314, 279, 324, 55965, 321, 279, 509, 51554, 9117, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 14084, 314, 9002, 5802, 7920, 23221, 279, 16382, 13, 1216, 557, 3221, 364, 9117, 8720, 11, 264, 30490, 551, 995, 4284, 685, 303, 780, 2843, 1578, 310, 2426, 780, 3838, 23598, 2261, 279, 1248, 11, 20413, 20803, 13, 271, 1465, 5312, 424, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 11, 3043, 279, 25888, 3438, 17299, 314, 279, 22317, 13, 1049, 557, 524, 9117, 8720, 13, 1049, 557, 264, 16002, 13, 271, 2064, 557, 264, 6121, 5983, 8720, 25347, 11, 18473, 440, 34830, 421, 995, 41423, 694, 5467, 7239, 13, 1049, 557, 2235, 2218, 7912, 3342, 2235, 11, 8106, 777, 13, 561, 2306, 995, 1248, 2394, 53798, 11, 9101, 1132, 264, 36334, 11, 19261, 391, 20158, 314, 264, 8026, 725, 69482, 13, 82697, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 6235, 13, 1216, 33757, 424, 13, 357, 8153, 348, 337, 643, 9, 52297, 4613, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 13, 561, 3626, 557, 8981, 11, 279, 9662, 412, 375, 2631, 1472, 279, 43369, 303, 279, 9506, 13876, 13, 82697, 7338, 364, 264, 1248, 854, 11, 35556, 506, 279, 16002, 13, 1216, 6273, 264, 14457, 80087, 310, 1724, 424, 11, 264, 90382, 662, 8950, 314, 29310, 13, 733, 25292, 1578, 11, 551, 995, 1669, 1599, 2433, 36251, 685, 383, 279, 29199], "info": "DONE 512 33 246.1 6313.6 length 257 452 0 325661 333015 0 0 0.0 33 200 chunk=0 experts_streamed=0", "sha": "49fbed07560bcab3", "gpu": {"0": {"util": 44.5, "power_w": 122.7, "n": 33}, "1": {"util": 57.3, "power_w": 129.0, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 99.54891896095816, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1328, 18054, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 220, 653, 20098, 310, 279, 3555, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 285, 638, 4381, 283, 2168, 220, 653, 20098, 310, 279, 1727, 2357, 318, 83, 79141, 436, 34810, 809, 8, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 285, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 285, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 198, 670, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 670, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 271, 262, 1848, 359, 447, 1170, 198, 285, 471, 1368, 1328, 6513, 11, 3166, 1141, 2357, 310, 279, 1901, 318, 17896, 52, 2234, 8, 198, 285, 471, 3301, 279, 869, 271, 262, 1848, 359, 611, 1170, 198, 285, 471, 1368, 1328, 6513, 11, 2560, 869, 321, 3166, 2357, 310, 1901, 198, 285, 471, 1368, 1328, 3070, 914, 2905, 11, 1791, 491, 2357, 11, 884, 310, 1901, 11, 198, 670, 321, 413, 8390, 32689, 11, 3921, 9495, 2357, 318, 19504, 52, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 38406, 6607, 37208, 11256, 318], "info": "DONE 512 36 243.5 5143.2 length 338 438 0 268839 282248 0 0 0.0 36 1447 chunk=0 experts_streamed=0", "sha": "59c29287129a1108", "gpu": {"0": {"util": 47.7, "power_w": 121.4, "n": 27}, "1": {"util": 60.4, "power_w": 127.6, "n": 27}}}, {"kind": "facts", "gen": 495, "tok_s": 94.28212258580626, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 264, 7099, 2982, 314, 220, 20, 16, 15, 3410, 12754, 28495, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 42120, 682, 279, 37847, 1007, 11, 25720, 449, 25659, 2094, 279, 7806, 303, 1066, 220, 23, 23, 8964, 2756, 13, 198, 17, 15, 13, 76879, 682, 279, 21354, 1007, 11, 4483, 220, 16, 21, 20, 8964, 1578, 310, 4434, 799, 25659, 2094, 279, 7806, 13, 248046], "info": "DONE 495 37 321.2 5250.2 stop 322 436 0 263091 279445 0 0 0.0 37 1670 chunk=0 experts_streamed=0", "sha": "063dcd7ffe616f19", "gpu": {"0": {"util": 45.0, "power_w": 120.0, "n": 28}, "1": {"util": 58.5, "power_w": 125.4, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.6915602666027, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9962.4 137.5 length 4 4 0 2566 3370 0 0 0.0 16405 145 chunk=8192 experts_streamed=36330", "tok_s": null, "gpu": {"0": {"util": 63.7, "power_w": 108.6, "n": 50}, "1": {"util": 59.7, "power_w": 110.0, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2836.7859117784683, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 21158.1 120.4 length 4 4 16384 3009 3488 0 0 0.0 43637 76 chunk=8192 experts_streamed=103140", "tok_s": null, "gpu": {"0": {"util": 74.2, "power_w": 117.7, "n": 107}, "1": {"util": 74.2, "power_w": 120.2, "n": 107}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 1, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.91213643490225, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 27044, 440, 2919, 321, 8106, 2414, 745, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 82697, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383], "info": "DONE 512 33 312.0 6250.6 length 258 457 0 329477 335869 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "da12ccce0593f5b4", "gpu": {"0": {"util": 44.2, "power_w": 120.5, "n": 32}, "1": {"util": 56.9, "power_w": 128.0, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 100.47095761381476, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 3929, 318, 3444, 3110, 553, 198, 262, 471, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 198, 406, 3514, 29015, 279, 3140, 5742, 1429, 2357, 318, 14166, 3008, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569], "info": "DONE 512 36 289.8 5096.0 length 339 437 0 270723 283242 0 0 0.0 36 1321 chunk=0 experts_streamed=0", "sha": "1199e5b1769e4630", "gpu": {"0": {"util": 46.2, "power_w": 120.6, "n": 27}, "1": {"util": 57.0, "power_w": 126.6, "n": 27}}}, {"kind": "facts", "gen": 479, "tok_s": 91.68341468083071, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 8252, 3605, 22573, 11, 264, 14120, 13071, 7875, 1056, 8964, 421, 682, 51216, 364, 22892, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 321, 1000, 2153, 303, 2919, 413, 264, 3349, 3213, 17415, 23533, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 9662, 13051, 11247, 440, 9662, 23944, 18176, 685, 310, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 21, 13, 76879, 557, 10782, 303, 220, 16, 23, 19, 21, 1472, 34780, 19292, 4598, 1056, 2050, 21254, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 682, 279, 1379, 77396, 314, 866, 11247, 11, 440, 506, 3140, 220, 24, 20, 10457, 5629, 45052, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 479 37 380.4 5224.5 stop 307 432 0 260331 277361 0 0 0.0 37 1771 chunk=0 experts_streamed=0", "sha": "d7638c129a00155d", "gpu": {"0": {"util": 45.3, "power_w": 118.4, "n": 28}, "1": {"util": 57.6, "power_w": 125.2, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1647.3860737884356, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9958.2 136.1 length 4 4 0 2483 3315 0 0 0.0 16405 170 chunk=8192 experts_streamed=35923", "tok_s": null, "gpu": {"0": {"util": 56.4, "power_w": 108.9, "n": 51}, "1": {"util": 64.9, "power_w": 110.0, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2961.060872911333, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20270.1 152.6 length 4 5 16384 3654 4345 0 0 0.0 43637 82 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 76.9, "power_w": 119.8, "n": 102}, "1": {"util": 82.2, "power_w": 123.5, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 1, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 83.26286346191375, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 6121, 5983, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 4613, 11, 85624, 2272, 279, 5445, 11, 557, 264, 37679, 21748, 8786, 314, 83132, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 13, 561, 8720, 557, 8981, 11, 694, 279, 8529, 9047, 310, 3222, 264, 14457, 39026, 13, 1216, 6316, 424, 888, 303, 780, 5888, 13, 2532, 557, 874, 2306, 11, 874, 20555, 11, 874, 26172, 314, 6042, 13, 4450, 279, 16002, 11, 279, 86249, 11, 321, 279, 21831, 2785, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279], "info": "DONE 512 33 310.9 6149.2 length 258 442 0 321452 327782 0 0 0.0 33 120 chunk=0 experts_streamed=0", "sha": "d8a295c262921617", "gpu": {"0": {"util": 45.9, "power_w": 121.5, "n": 32}, "1": {"util": 59.0, "power_w": 129.2, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 102.40819265541242, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 318, 3444, 3110, 553, 198, 262, 471, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 198, 406, 3514, 29015, 279, 9495, 2357, 318, 53415, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 6572, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11], "info": "DONE 512 36 293.2 4999.6 length 341 430 0 264768 277409 0 0 0.0 36 1397 chunk=0 experts_streamed=0", "sha": "610d88fa9f502690", "gpu": {"0": {"util": 39.3, "power_w": 119.8, "n": 26}, "1": {"util": 54.9, "power_w": 127.8, "n": 26}}}, {"kind": "facts", "gen": 479, "tok_s": 94.49968434343434, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 76663, 31784, 13, 198, 16, 24, 13, 561, 2943, 15484, 31784, 318, 41, 18925, 11, 47503, 11, 76925, 350, 11, 76879, 8, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 479 37 379.1 5068.8 stop 314 419 0 251981 268466 0 0 0.0 37 1734 chunk=0 experts_streamed=0", "sha": "90493fa673d32422", "gpu": {"0": {"util": 46.8, "power_w": 118.1, "n": 28}, "1": {"util": 58.0, "power_w": 125.4, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1651.4989832283004, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9933.4 138.0 length 4 4 0 2439 3294 0 0 0.0 16405 180 chunk=8192 experts_streamed=35940", "tok_s": null, "gpu": {"0": {"util": 56.8, "power_w": 109.0, "n": 50}, "1": {"util": 62.4, "power_w": 110.4, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2965.2886192518226, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20241.2 150.7 length 4 5 16384 3637 4325 0 0 0.0 43637 91 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.1, "power_w": 119.9, "n": 102}, "1": {"util": 83.2, "power_w": 123.3, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "pw1", "slots": "7238", "notes": ["strata generate: --pipeline-windows 1: 160 MiB of CUDA0 kept out of the expert cache (the second verifier)", "strata serve: --pipeline-windows 1: two verifiers per stage, 2 stages overlap across windows"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.29952204773173, "ids": [760, 29262, 506, 5068, 6451, 4963, 1467, 524, 15756, 38225, 26, 424, 61551, 13, 1049, 61199, 279, 32946, 11, 279, 9117, 11, 321, 279, 12515, 11, 9101, 1132, 279, 27163, 20569, 11, 21461, 50355, 314, 279, 324, 55965, 321, 279, 55218, 6851, 314, 82697, 645, 16413, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 6574, 557, 17032, 290, 539, 11679, 321, 9662, 11, 780, 5888, 10841, 430, 32524, 6451, 11, 321, 780, 6213, 279, 1829, 314, 279, 13071, 88, 21678, 13, 1216, 995, 8341, 279, 3000, 364, 25292, 1578, 11, 264, 37671, 748, 1248, 421, 279, 2136, 70704, 874, 4860, 5312, 1384, 430, 264, 1637, 11, 694, 430, 264, 4416, 314, 279, 17865, 11, 430, 14884, 321, 5689, 430, 279, 49577, 4924, 13, 271, 15514, 13618, 557, 264, 12647, 59452, 314, 95041, 13, 39235, 506, 220, 19, 25, 15, 15, 6556, 13, 4109, 279, 5415, 5684, 13, 30931, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 13, 12194, 279, 44798, 314, 279, 17507, 11, 13879, 364, 279, 10174, 276, 314, 279, 10679, 88663, 466, 279, 15268, 314, 264, 338, 602, 13, 4844, 11, 52736, 279, 39740, 59678, 11, 7923, 264, 16976, 314, 2503, 83, 463, 321, 3619, 10482, 11, 321, 3655, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 40613, 1029, 279, 12515, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 4570, 10994, 11, 264, 14590, 12931, 314, 542, 2104, 421, 10641, 1881, 279, 2255, 314, 279, 324, 55965, 321, 279, 509, 51554, 9117, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 14084, 314, 9002, 5802, 7920, 23221, 279, 16382, 13, 1216, 557, 3221, 364, 9117, 8720, 11, 264, 13727, 551, 6709, 12405, 685, 494, 780, 3200, 7168, 11, 49159, 11, 852, 11252, 421, 1396, 6365, 314, 5983, 466, 65326, 8720, 5467, 264, 11937, 314, 264, 8026, 86, 23862, 725, 3255, 13, 271, 1465, 1669, 4161, 314, 2647, 2980, 551, 5312, 424, 13, 271, 2064, 557, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 11, 3043, 279, 25888, 3438, 17299, 314, 279, 22317, 13, 357, 16002, 13, 2717, 264, 6278, 11840, 5303, 11, 694, 264, 11702, 11, 6121, 5983, 8720, 25347, 11, 18473, 440, 34830, 421, 995, 41423, 694, 5467, 7239, 13, 1049, 557, 8545, 11, 3107, 81, 26271, 440, 31253, 17668, 321, 30581, 580, 1222, 11, 3221, 2599, 1040, 264, 1876, 321, 777, 1040, 264, 58885, 494, 264, 3555, 4092, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 8981, 11, 47966, 440, 63993, 932, 13, 1216, 6316, 424, 888, 303, 780, 5888, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 279, 8720, 11, 6121, 321, 44932, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 13, 561, 3626, 557, 20413, 3525, 364, 279, 79496, 314, 279, 36600, 8598, 321, 279, 27786, 9626, 314, 16382, 2272, 279, 15787, 13, 1216, 7338, 364, 264, 1248], "info": "DONE 512 33 245.5 6297.7 length 258 447 0 323909 331102 0 0 0.0 33 206 chunk=0 experts_streamed=0", "sha": "5ca2d9d4411ea45d", "gpu": {"0": {"util": 45.4, "power_w": 122.6, "n": 33}, "1": {"util": 59.3, "power_w": 130.6, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 99.49668668260169, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 6572, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 6607, 4886, 303, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285, 7624, 4922, 283, 2357, 28044, 198, 285, 1727, 4922, 283], "info": "DONE 512 36 243.1 5145.9 length 341 437 0 265418 279641 0 0 0.0 36 1637 chunk=0 experts_streamed=0", "sha": "e738aaf2957f824f", "gpu": {"0": {"util": 45.1, "power_w": 119.9, "n": 27}, "1": {"util": 60.8, "power_w": 128.4, "n": 27}}}, {"kind": "facts", "gen": 489, "tok_s": 91.3625917829718, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 8252, 3605, 22573, 11, 264, 14120, 13071, 7875, 1056, 8964, 421, 682, 51216, 364, 22892, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 321, 1000, 2153, 303, 2919, 413, 264, 3349, 3213, 17415, 23533, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 682, 279, 1379, 77396, 314, 866, 11247, 11, 440, 220, 24, 20, 10457, 5629, 45052, 430, 314, 220, 17, 15, 17, 18, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 489 37 319.9 5352.3 stop 316 437 0 261465 279507 0 0 0.0 37 2051 chunk=0 experts_streamed=0", "sha": "08b8a67f7c0f8441", "gpu": {"0": {"util": 47.4, "power_w": 118.5, "n": 28}, "1": {"util": 63.2, "power_w": 125.1, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1645.1887880459308, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9971.5 138.6 length 4 4 0 2520 3346 0 0 0.0 16405 164 chunk=8192 experts_streamed=36396", "tok_s": null, "gpu": {"0": {"util": 52.9, "power_w": 109.5, "n": 50}, "1": {"util": 66.6, "power_w": 110.0, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2960.9001933777968, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20271.2 146.9 length 3 4 16384 3297 3912 0 0 0.0 43637 63 chunk=8192 experts_streamed=103140", "tok_s": null, "gpu": {"0": {"util": 69.7, "power_w": 119.8, "n": 102}, "1": {"util": 81.7, "power_w": 123.2, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.14870198632994, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 11, 27044, 440, 2414, 4613, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 1216, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1690, 264, 1248, 854, 11, 551, 1066, 42578, 506, 424, 13, 1049, 6273, 1040], "info": "DONE 512 33 314.6 6232.6 length 258 458 0 329477 335853 0 0 0.0 33 123 chunk=0 experts_streamed=0", "sha": "afd22e324d2d9940", "gpu": {"0": {"util": 45.0, "power_w": 121.6, "n": 33}, "1": {"util": 53.2, "power_w": 128.2, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 100.49462196749627, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 9495, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 7261, 5742, 1429, 3008, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 87401, 5742, 1429, 3008, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 1061, 632, 15412, 279, 2357, 494, 1141, 18146, 11, 13057, 17068, 424, 198], "info": "DONE 512 36 294.5 5094.8 length 340 438 0 269271 282185 0 0 0.0 36 1434 chunk=0 experts_streamed=0", "sha": "312de79b868099ca", "gpu": {"0": {"util": 46.2, "power_w": 119.9, "n": 26}, "1": {"util": 64.1, "power_w": 125.4, "n": 26}}}, {"kind": "facts", "gen": 494, "tok_s": 90.83219946309711, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 37847, 1834, 314, 866, 11247, 11, 25720, 264, 12331, 303, 1066, 220, 24, 13, 24, 3979, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 12784, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 494 37 390.6 5438.6 stop 314 444 0 269519 286817 0 0 0.0 37 1899 chunk=0 experts_streamed=0", "sha": "058e2202fc7e53c6", "gpu": {"0": {"util": 44.2, "power_w": 118.6, "n": 30}, "1": {"util": 54.2, "power_w": 125.1, "n": 30}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.2784373149757, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9964.9 136.8 length 4 4 0 2534 3357 0 0 0.0 16405 149 chunk=8192 experts_streamed=35926", "tok_s": null, "gpu": {"0": {"util": 56.5, "power_w": 109.4, "n": 50}, "1": {"util": 64.0, "power_w": 110.7, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2952.655968673442, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20327.8 145.3 length 3 4 16384 3341 3925 0 0 0.0 43637 70 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.3, "power_w": 120.0, "n": 103}, "1": {"util": 82.8, "power_w": 123.0, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.49548852797113, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 312.5 6206.4 length 259 460 0 329181 335731 0 0 0.0 33 126 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 44.6, "power_w": 121.2, "n": 33}, "1": {"util": 56.2, "power_w": 128.1, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 94.05886027115406, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 4886, 318, 2083, 1144, 310, 1716, 364, 2168, 948, 17068, 14, 2903, 553, 271, 262, 9266, 1906, 318, 1445, 1901, 310, 9495, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 271, 262, 1848, 359, 447, 1170, 3166, 23975, 2357, 310, 1066, 1238, 1901, 318, 3444, 5742, 1429, 553, 198, 262, 1848, 359, 611, 1170, 884, 28856, 2357, 506, 1901, 26, 413, 888, 8390, 11, 3921, 2357, 1518, 9495, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25], "info": "DONE 512 36 291.4 5443.4 length 327 450 0 283666 295696 0 0 0.0 36 1152 chunk=0 experts_streamed=0", "sha": "bc30fe07ca8e50d3", "gpu": {"0": {"util": 43.6, "power_w": 120.3, "n": 29}, "1": {"util": 61.5, "power_w": 125.8, "n": 29}}}, {"kind": "facts", "gen": 495, "tok_s": 94.92032445492724, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 6149, 364, 506, 3140, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 495 37 419.6 5214.9 stop 319 429 0 263361 278773 0 0 0.0 37 1563 chunk=0 experts_streamed=0", "sha": "1f884adfc9a80ad5", "gpu": {"0": {"util": 42.6, "power_w": 118.5, "n": 28}, "1": {"util": 59.4, "power_w": 125.3, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1648.9923103985527, "ids": [2495, 450, 369, 264, 2136, 14791, 4560, 364], "info": "DONE 8 16405 9948.5 168.6 length 3 5 0 3147 4203 0 0 0.0 16405 182 chunk=8192 experts_streamed=35882", "tok_s": null, "gpu": {"0": {"util": 54.2, "power_w": 108.7, "n": 51}, "1": {"util": 56.7, "power_w": 108.8, "n": 51}}, "sha": "3a17b0b54df13952"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2956.000551593712, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20304.8 145.4 length 4 5 16384 3843 4411 0 0 0.0 43637 59 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 81.6, "power_w": 120.2, "n": 102}, "1": {"util": 75.1, "power_w": 123.4, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 2, "arm": "pw2s0", "slots": "6594", "notes": ["strata generate: --pipeline-windows 2: 272 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 72.45658972871234, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 49577, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 28486, 310, 279, 1814, 7551, 279, 32946, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 271, 1465, 11815, 7249, 11, 3462, 364, 279, 338, 68042, 421, 58330, 506, 279, 20618, 725, 15686, 321, 279, 26957, 7892, 14882, 421, 11136, 2957, 264, 2182, 13, 561, 29310, 557, 524, 264, 23339, 26, 424, 557, 264, 5576, 13, 82697, 995, 27968, 279, 11639, 314, 279, 3177, 11, 279, 52010, 314, 11532, 11, 321, 279, 57040, 7244, 364, 4906, 13, 5514, 11, 279, 1132, 7244, 557, 3000, 13, 13262, 424, 19074, 13, 13262, 279, 17199, 5902, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 78080, 279, 21678, 1083, 264, 12431, 25577, 11, 17960, 17024, 11, 421, 82697, 1669, 279, 16002, 13, 271, 1465, 557, 11107, 279, 94682, 11, 264, 13727, 551, 8341, 310, 1716, 364, 32871, 421, 2493, 5383, 279, 15787, 466, 11, 777, 22103, 11, 310, 2708, 279, 1752, 364, 279, 7892, 14882, 725, 19710, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 14084, 314, 25888, 3438, 22317, 421, 998, 5802, 81179, 13, 20994, 279, 259, 3908, 314, 580, 1222, 321, 31253, 7653, 46004, 26271, 25374, 11, 2414, 10255, 279, 7234, 12967, 3000, 13, 271, 2064, 557, 264, 16002, 13, 2717, 264, 6278, 11840, 25347, 11, 694, 264, 11702, 11, 6121, 5983, 8720, 11, 18473, 440, 34830, 421, 995, 68342, 1083, 264, 3565, 11, 39943, 46912, 13, 1049, 557, 4139, 1402, 322, 1086, 303, 279, 9002, 11, 82951, 506, 449, 8937, 430, 413, 424, 995, 978, 8826, 1017, 33931, 4598, 1056, 36251, 685, 539, 5823, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 13, 561, 8720, 557, 8981, 11, 47966, 440, 63993, 932, 11, 321, 9469, 303, 264, 6699, 6000, 314, 39567, 13, 1216, 6316, 424, 888, 303, 780, 5888, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 279, 8720, 11, 279, 34830, 11, 321, 279, 36334, 11, 89093, 11051, 314, 2414, 4613, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 6047, 424, 383, 279, 9488, 1898, 13, 561, 2956, 557, 32335, 25, 264, 6113, 12, 2395, 42558, 11, 264, 3074, 10183, 11], "info": "DONE 512 33 264.8 7066.3 length 256 452 0 403871 411385 0 0 0.0 33 132 chunk=0 experts_streamed=0", "sha": "be748469b6dbf0b6", "gpu": {"0": {"util": 83.6, "power_w": 133.7, "n": 37}, "1": {"util": 49.0, "power_w": 119.7, "n": 37}}}, {"kind": "code", "gen": 512, "tok_s": 99.14986734832202, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 318, 3444, 3110, 553, 198, 262, 471, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 198, 406, 3514, 29015, 279, 9495, 2357, 318, 53415, 5742, 1429, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231], "info": "DONE 512 36 255.1 5163.9 length 327 457 0 325182 340356 0 0 0.0 36 1579 chunk=0 experts_streamed=0", "sha": "47ca0a02fa65b579", "gpu": {"0": {"util": 76.5, "power_w": 134.9, "n": 27}, "1": {"util": 59.7, "power_w": 120.4, "n": 27}}}, {"kind": "facts", "gen": 486, "tok_s": 86.4968765016819, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 220, 22, 16, 4, 2919, 11, 26747, 424, 279, 28439, 328, 1719, 8432, 27893, 1149, 198, 22, 13, 20403, 369, 3750, 430, 279, 328, 5844, 27893, 1, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 17882, 279, 7526, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 17, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 279, 37847, 1834, 314, 866, 11247, 11, 25720, 264, 12331, 303, 1066, 220, 24, 3979, 321, 220, 20, 21, 4276, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 220, 23, 31784, 303, 279, 12570, 1785, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 279, 1379, 314, 866, 11247, 13, 198, 17, 15, 13, 42120, 369, 279, 24830, 11247, 11, 25659, 286, 279, 7806, 506, 449, 5289, 4478, 314, 220, 19, 22, 13, 19, 12754, 2600, 13, 248046], "info": "DONE 486 37 339.5 5618.7 stop 301 469 0 337487 359663 0 0 0.0 37 2571 chunk=0 experts_streamed=0", "sha": "6d36f714d54583b0", "gpu": {"0": {"util": 79.5, "power_w": 134.6, "n": 30}, "1": {"util": 57.3, "power_w": 120.6, "n": 30}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1590.248158200853, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 10316.0 169.7 length 5 5 0 2864 4058 0 0 0.0 16405 264 chunk=8192 experts_streamed=36962", "tok_s": null, "gpu": {"0": {"util": 71.1, "power_w": 111.2, "n": 52}, "1": {"util": 51.7, "power_w": 106.1, "n": 52}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2825.275485659683, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 21244.3 136.6 length 4 6 16384 3864 4694 0 0 0.0 43637 154 chunk=8192 experts_streamed=104532", "tok_s": null, "gpu": {"0": {"util": 77.2, "power_w": 120.8, "n": 107}, "1": {"util": 75.8, "power_w": 119.7, "n": 107}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 3, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.24899598393574, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 424, 6749, 11, 9896, 440, 2414, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733, 279, 51624, 725, 30439, 11, 1172, 279, 7948, 34774, 314, 279, 5415, 27056, 11, 551, 8826, 279, 16002, 383, 780, 944, 26157, 13, 1216, 23354, 424, 364, 3979, 13, 2532, 998, 874, 61909, 383, 279, 8720, 11, 874, 2306, 11, 874, 2321, 13, 4450, 279, 5365, 6105, 37747], "info": "DONE 512 33 315.0 6225.0 length 259 464 0 331093 337653 0 0 0.0 33 125 chunk=0 experts_streamed=0", "sha": "008dccf84b36532a", "gpu": {"0": {"util": 43.2, "power_w": 121.3, "n": 32}, "1": {"util": 60.1, "power_w": 129.5, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 99.64966913195795, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 279, 6297, 23716, 1141, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 10539, 440, 264, 2972, 8038, 2336, 332, 310, 10752, 2972, 46, 7, 16, 31230, 854, 22373, 364, 2107, 1510, 447, 63, 321, 1510, 611, 63, 7289, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 279, 6297, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198, 12, 2113, 4702, 11, 869, 1590, 81828, 14, 47989, 1328, 18509, 6505, 13, 1368, 8390, 32689, 11, 198, 220, 3514, 29015, 9495, 2357, 13, 496, 7, 16, 553, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 271, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 561, 6297, 1328, 318, 39470, 364, 75555, 310, 3921, 494, 5010, 2336, 8, 198, 262, 471, 869, 25, 561, 19954, 869, 198, 262, 471, 7624, 25, 16699, 310, 279, 3555, 2357, 318, 83, 79141, 9495, 593, 3140, 5742, 1429, 8, 198, 262, 471, 1727, 25, 16699, 310, 279, 1727, 2357, 318, 83, 79141, 1901, 593, 1379, 5742, 1429, 8, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 561, 90651, 52589, 1103, 682, 1330, 77991, 7552, 25, 198, 262, 471, 1901, 25, 54894, 1518, 279, 1379, 5742, 1429, 2357, 198, 262, 471, 9495, 25, 54894, 1238, 279, 3140, 5742, 1429, 2357, 271, 262, 1061, 15036, 9319, 6607, 37208, 11256, 318, 2083, 1144, 310, 1716, 364, 2168, 7624, 14, 3480, 198, 262, 948, 17068, 466, 37029, 7552, 553, 271, 262, 9266, 1906, 318, 1445, 1901, 310, 9495, 1590, 198, 285, 1901, 64575, 498, 17896, 52, 60, 64575, 2423, 64575, 498, 19504, 52, 60, 64575, 9495, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628], "info": "DONE 512 36 293.0 5138.0 length 337 446 0 275869 288261 0 0 0.0 36 1199 chunk=0 experts_streamed=0", "sha": "e3d15a74b1c3bcaa", "gpu": {"0": {"util": 45.1, "power_w": 120.5, "n": 27}, "1": {"util": 60.9, "power_w": 128.7, "n": 27}}}, {"kind": "facts", "gen": 494, "tok_s": 94.03612967087355, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 11, 440, 74926, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 12784, 364, 888, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 494 37 388.8 5253.3 stop 318 439 0 268246 283522 0 0 0.0 37 1500 chunk=0 experts_streamed=0", "sha": "83061dd58b8fb934", "gpu": {"0": {"util": 45.7, "power_w": 119.3, "n": 29}, "1": {"util": 58.8, "power_w": 126.6, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.8899329398064, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9961.2 135.5 length 4 4 0 2570 3371 0 0 0.0 16405 159 chunk=8192 experts_streamed=35916", "tok_s": null, "gpu": {"0": {"util": 72.4, "power_w": 110.0, "n": 50}, "1": {"util": 52.3, "power_w": 110.4, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2956.4519227453857, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20301.7 152.8 length 4 5 16384 3679 4349 0 0 0.0 43637 92 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 75.5, "power_w": 119.8, "n": 102}, "1": {"util": 78.5, "power_w": 123.3, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.47821254248757, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 11, 430, 413, 279, 8529, 998, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 1216, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1690, 264, 1248, 854, 11, 551, 1066, 42578, 506, 424, 13, 1049], "info": "DONE 512 33 314.5 6207.7 length 258 453 0 326614 332993 0 0 0.0 33 122 chunk=0 experts_streamed=0", "sha": "6d21e457c493340d", "gpu": {"0": {"util": 46.5, "power_w": 121.8, "n": 33}, "1": {"util": 58.4, "power_w": 129.7, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 99.91023689653827, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1328, 18054, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 9495, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 7261, 5742, 1429, 3008, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 87401, 5742, 1429, 3008, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285, 7624, 4922, 283], "info": "DONE 512 36 299.1 5124.6 length 344 444 0 270462 283755 0 0 0.0 36 1497 chunk=0 experts_streamed=0", "sha": "c1bbb731e33f6901", "gpu": {"0": {"util": 44.3, "power_w": 118.9, "n": 27}, "1": {"util": 62.6, "power_w": 128.3, "n": 27}}}, {"kind": "facts", "gen": 465, "tok_s": 92.11386462233315, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 864, 369, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 303, 279, 12570, 1785, 321, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 440, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 430, 7246, 539, 94370, 579, 6657, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 76663, 31784, 13, 198, 16, 24, 13, 561, 2943, 15484, 31784, 318, 41, 18925, 11, 47503, 11, 76925, 350, 11, 76879, 8, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 248046], "info": "DONE 465 37 396.3 5048.1 stop 303 410 0 245664 262719 0 0 0.0 37 1832 chunk=0 experts_streamed=0", "sha": "322511ecf38cdf2a", "gpu": {"0": {"util": 44.0, "power_w": 118.4, "n": 27}, "1": {"util": 61.4, "power_w": 126.3, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1644.6939696225375, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9974.5 136.6 length 4 4 0 2559 3361 0 0 0.0 16405 148 chunk=8192 experts_streamed=35955", "tok_s": null, "gpu": {"0": {"util": 57.2, "power_w": 109.3, "n": 51}, "1": {"util": 63.3, "power_w": 110.9, "n": 51}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2953.2516224899996, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20323.7 153.7 length 4 5 16384 3634 4327 0 0 0.0 43637 94 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 74.5, "power_w": 120.6, "n": 102}, "1": {"util": 83.3, "power_w": 123.4, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 3, "arm": "pw2s0", "slots": "6594", "notes": ["strata generate: --pipeline-windows 2: 272 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 70.15236216156966, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 13988, 37260, 36781, 86788, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 49577, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 271, 1465, 11815, 7249, 11, 3462, 364, 279, 338, 68042, 421, 58330, 506, 279, 20618, 725, 15686, 321, 279, 26957, 7892, 14882, 421, 11136, 2957, 264, 2182, 11, 24304, 78902, 314, 259, 19936, 3487, 11, 580, 6067, 1885, 11, 321, 30457, 421, 998, 2582, 2250, 5381, 2235, 13, 82697, 14459, 424, 411, 1560, 13, 561, 48331, 557, 264, 1925, 314, 11639, 11, 314, 16175, 11, 314, 1208, 852, 6749, 506, 488, 321, 5312, 1132, 1092, 781, 4674, 310, 1436, 13, 5514, 11, 506, 279, 6607, 314, 279, 1814, 11, 551, 557, 4777, 264, 709, 13, 357, 51624, 314, 3000, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 78080, 279, 21678, 1083, 264, 12431, 1540, 2093, 35360, 2176, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 94682, 11, 264, 13727, 551, 8341, 310, 1716, 364, 32871, 421, 2493, 5383, 279, 15787, 466, 11, 777, 22103, 11, 310, 1353, 364, 279, 2433, 279, 9117, 60766, 680, 13, 1216, 14428, 440, 780, 1901, 1441, 11, 6213, 33939, 279, 13988, 9002, 364, 32524, 6451, 11, 11840, 11, 466, 279, 26957, 33049, 1254, 50139, 314, 264, 8026, 86, 23862, 13, 561, 40554, 557, 3238, 11, 44431, 264, 25888, 3438, 17865, 314, 3565, 22317, 321, 40554, 32039, 13, 271, 1465, 5312, 424, 4139, 1402, 322, 1086, 303, 264, 10582, 314, 580, 1222, 11, 3043, 279, 2255, 314, 279, 17631, 41586, 13, 1049, 5532, 1357, 32524, 6451, 13, 1049, 557, 8720, 13, 271, 36, 69388, 23928, 88239, 13, 561, 16002, 557, 6121, 5983, 11, 11702, 2543, 4583, 11, 321, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 1049, 6749, 13437, 11, 3482, 279, 8720, 557, 632, 47272, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 264, 10558, 11, 47514, 7099, 40373, 279, 19177, 12515, 13, 271, 1465, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 13, 26482, 11, 37679, 21748, 11, 557, 264, 6365, 314, 83132, 13, 271, 36, 69388, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264], "info": "DONE 512 33 262.6 7298.4 length 242 454 0 405486 413350 0 0 0.0 33 139 chunk=0 experts_streamed=0", "sha": "f110daae9f30821e", "gpu": {"0": {"util": 78.5, "power_w": 134.4, "n": 38}, "1": {"util": 51.6, "power_w": 121.0, "n": 38}}}, {"kind": "code", "gen": 512, "tok_s": 91.27210496292071, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1328, 18054, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 1919, 7873, 79744, 496, 7, 16, 8, 854, 22373, 364, 2107, 615, 321, 2113, 7289, 198, 940, 264, 10286, 314, 264, 5010, 2336, 321, 264, 90651, 52589, 1103, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 16, 25, 5829, 3124, 318, 1891, 11048, 90651, 52589, 1103, 5313, 8, 198, 2, 15692, 10089, 198, 1005, 5829, 25, 198, 262, 4071, 198, 262, 37606, 264, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 1031, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 436, 34810, 809, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 1031, 262, 561, 10278, 1103, 30941, 1906, 25, 198, 262, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 262, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 17, 25, 436, 34810, 18887, 3124, 318, 50342, 29806, 8, 198, 2, 15692, 10089, 198, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 87401, 39642, 11851, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 1031, 262, 2791, 67678, 25, 198, 262, 471, 6297, 25, 6249, 12366, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 1901, 5350, 589, 25, 77991, 7552, 314, 264, 90651, 52589, 1103, 19720, 10121, 1906, 6987, 262, 733, 52778, 25, 198, 262, 471, 6297, 2406, 363, 2564, 8390, 198, 262, 471, 12734, 1103, 1906, 25133, 2528, 1347, 2179, 318, 1916, 283, 27412, 52, 11, 9495, 283, 436, 34810, 8, 198, 262, 471, 6983, 1328, 303, 6297, 682, 264, 11811, 2357, 303, 279, 10278, 1103, 11, 321, 16282, 43782, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 198, 1726, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198], "info": "DONE 512 36 247.7 5609.6 length 306 486 0 360632 375333 0 0 0.0 36 1281 chunk=0 experts_streamed=0", "sha": "da0f0d0ae458a0f0", "gpu": {"0": {"util": 87.7, "power_w": 136.0, "n": 30}, "1": {"util": 57.0, "power_w": 123.1, "n": 30}}}, {"kind": "facts", "gen": 378, "tok_s": 87.63185348325025, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 77396, 321, 874, 16078, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 318, 2054, 298, 6721, 12331, 553, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 1330, 2526, 77396, 6725, 2274, 656, 428, 321, 1526, 23352, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 10457, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 1801, 314, 9561, 321, 6730, 13, 198, 16, 17, 13, 47503, 682, 506, 3140, 220, 16, 19, 21, 10457, 77396, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 220, 16, 19, 3750, 77396, 13, 198, 16, 22, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 23672, 717, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 31784, 303, 279, 23672, 717, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 24, 13, 48017, 725, 8252, 3605, 22573, 369, 264, 13071, 7875, 1056, 8964, 421, 682, 34242, 364, 888, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 42120, 682, 279, 37847, 1007, 303, 279, 23672, 717, 506, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 378 37 348.7 4313.5 stop 235 363 0 256202 273036 0 0 0.0 37 1949 chunk=0 experts_streamed=0", "sha": "1d386e2f4b3d33ee", "gpu": {"0": {"util": 89.8, "power_w": 133.7, "n": 23}, "1": {"util": 64.8, "power_w": 121.9, "n": 23}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1593.7241948802643, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 10293.5 149.6 length 4 4 0 2884 3784 0 0 0.0 16405 166 chunk=8192 experts_streamed=36852", "tok_s": null, "gpu": {"0": {"util": 71.5, "power_w": 111.0, "n": 52}, "1": {"util": 58.2, "power_w": 108.0, "n": 52}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2822.100600897114, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 21268.2 120.4 length 4 4 16384 3799 4378 0 0 0.0 43637 82 chunk=8192 experts_streamed=104532", "tok_s": null, "gpu": {"0": {"util": 69.0, "power_w": 120.9, "n": 107}, "1": {"util": 76.5, "power_w": 120.9, "n": 107}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 3, "arm": "pw1", "slots": "7238", "notes": ["strata generate: --pipeline-windows 1: 160 MiB of CUDA0 kept out of the expert cache (the second verifier)", "strata serve: --pipeline-windows 1: two verifiers per stage, 2 stages overlap across windows"], "rows": [{"kind": "story", "gen": 512, "tok_s": 81.1616257688162, "ids": [760, 29262, 506, 5068, 6451, 4963, 1467, 524, 15756, 38225, 26, 424, 61551, 13, 1049, 61199, 279, 32946, 11, 279, 9117, 11, 321, 279, 12515, 11, 9101, 1132, 279, 27163, 20569, 11, 21461, 50355, 314, 279, 324, 55965, 321, 279, 55218, 6851, 314, 82697, 645, 16413, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 6574, 557, 17032, 290, 539, 11679, 321, 9662, 11, 780, 5888, 10841, 430, 32524, 6451, 11, 321, 780, 6213, 279, 1829, 314, 279, 13071, 88, 21678, 13, 1216, 995, 8341, 279, 3000, 364, 25292, 1578, 11, 264, 37671, 748, 1248, 421, 279, 2136, 70704, 874, 4860, 5312, 1384, 430, 264, 1637, 11, 694, 430, 264, 4416, 314, 279, 17865, 11, 430, 14884, 321, 5689, 430, 279, 22317, 5402, 13, 271, 15514, 13618, 557, 264, 12647, 59452, 314, 95041, 13, 39235, 506, 220, 19, 25, 15, 15, 6556, 13, 4109, 279, 17796, 13, 30931, 279, 34844, 13, 2743, 279, 8831, 13, 43036, 264, 16976, 314, 69219, 40401, 321, 3565, 10482, 13, 10049, 279, 6797, 9704, 11, 413, 424, 1362, 381, 3753, 13, 43311, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 338, 3703, 998, 6941, 310, 12931, 279, 1483, 10583, 494, 279, 43407, 36620, 12052, 93028, 310, 279, 41586, 2835, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 94682, 11, 264, 13727, 551, 17852, 310, 1716, 364, 32871, 421, 2493, 38463, 279, 2255, 314, 279, 20618, 466, 11, 777, 22103, 11, 310, 1353, 364, 11590, 314, 32877, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 25888, 3438, 26748, 314, 3565, 2948, 3045, 421, 5802, 10641, 81179, 13, 561, 9662, 557, 64829, 11, 14885, 279, 39029, 314, 73823, 321, 29712, 13, 271, 1465, 5312, 424, 4139, 1402, 322, 1086, 303, 264, 1819, 1706, 1881, 1330, 292, 601, 382, 11, 10523, 3438, 9990, 539, 279, 1347, 15626, 40554, 13, 1049, 557, 524, 264, 16002, 303, 279, 22735, 11, 62479, 5357, 2218, 2083, 86249, 11, 874, 34830, 24544, 11, 874, 24956, 8720, 13, 1049, 557, 264, 11702, 11, 75821, 5303, 1801, 314, 6121, 11, 44932, 11840, 11, 279, 2993, 1429, 364, 12419, 24464, 466, 1496, 38895, 44026, 13, 1049, 557, 76911, 11, 1100, 39234, 440, 31253, 17668, 11, 321, 1505, 26271, 440, 30581, 580, 1222, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 8545, 13, 1216, 33757, 424, 13, 23879, 28028, 4613, 440, 264, 39192, 270, 643, 13, 271, 1465, 11354, 424, 1142, 310, 279, 51624, 725, 44104, 11, 264, 9506, 5759, 304, 81201, 2272, 279, 2255, 314, 279, 20618, 13, 26482, 11, 279, 3594, 557, 7948, 11, 92685, 314, 13254, 25588, 321, 2235, 5392, 13, 1216, 8826, 279, 5303, 383, 780, 944, 26157, 11, 23221, 279, 24149, 77371, 314, 264, 14333, 11369, 27056, 13, 271, 15947, 264, 509, 63088, 321, 264, 22725, 11, 551, 15060, 41423, 279, 24544, 13, 561, 11840, 6348, 1560, 440, 264, 91380, 10343, 13, 26482, 11, 18880, 303, 13224, 314, 5415, 84922, 321, 18473, 2785, 264, 27286, 8697, 11], "info": "DONE 512 33 242.2 6308.4 length 257 442 0 322370 329670 0 0 0.0 33 205 chunk=0 experts_streamed=0", "sha": "4fe92a6e4e5ed327", "gpu": {"0": {"util": 51.4, "power_w": 121.7, "n": 33}, "1": {"util": 60.9, "power_w": 130.9, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 100.18001095718868, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 220, 653, 20098, 310, 279, 3555, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 285, 638, 4381, 283, 2168, 220, 653, 20098, 310, 279, 1727, 2357, 318, 83, 79141, 436, 34810, 809, 8, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 406, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 271, 262, 1848, 1510, 447, 43143, 3166, 279, 23975, 2357, 310, 279, 1901, 318, 17896, 52, 2234, 553, 198, 262, 1848, 1510, 611, 43143, 5479, 28856, 506, 1901, 26, 413, 888, 8390, 11, 3921, 9495, 318, 19504, 52, 553, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 38406, 6607, 37208, 11256, 318, 2083, 2168, 11988, 364, 1901, 5350, 589, 8, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 48864, 1901, 318, 17896, 52, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 48864, 9495, 318, 19504, 52], "info": "DONE 512 36 240.3 5110.8 length 339 437 0 267694 281195 0 0 0.0 36 1494 chunk=0 experts_streamed=0", "sha": "d0ef62ad571aa5e8", "gpu": {"0": {"util": 46.2, "power_w": 120.4, "n": 27}, "1": {"util": 60.6, "power_w": 128.8, "n": 27}}}, {"kind": "facts", "gen": 507, "tok_s": 92.84013916865042, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 440, 47437, 1544, 14880, 1602, 279, 7526, 17257, 303, 279, 12570, 1785, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 1942, 7810, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 62409, 17800, 23245, 494, 220, 23, 23, 2756, 318, 25863, 24648, 8, 310, 220, 16, 21, 20, 1578, 318, 8547, 50168, 553, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 11, 1345, 279, 2943, 15484, 31784, 513, 6605, 466, 9561, 43701, 13, 198, 16, 24, 13, 48017, 579, 8252, 3605, 22573, 369, 264, 24207, 13071, 7875, 1056, 8964, 11, 12784, 364, 888, 220, 18, 20, 15, 1578, 13, 198, 17, 15, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 11, 9101, 7810, 3813, 31784, 303, 279, 12570, 1785, 13, 248046], "info": "DONE 507 37 317.6 5461.0 stop 327 453 0 273026 290641 0 0 0.0 37 1871 chunk=0 experts_streamed=0", "sha": "d2ca1951ddc13250", "gpu": {"0": {"util": 48.9, "power_w": 118.8, "n": 29}, "1": {"util": 58.9, "power_w": 127.0, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1650.7179440738169, "ids": [2495, 450, 369, 264, 2136, 14791, 4560, 364], "info": "DONE 8 16405 9938.1 164.3 length 3 4 0 2781 3750 0 0 0.0 16405 169 chunk=8192 experts_streamed=36387", "tok_s": null, "gpu": {"0": {"util": 61.4, "power_w": 108.2, "n": 50}, "1": {"util": 62.1, "power_w": 110.5, "n": 50}}, "sha": "3a17b0b54df13952"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2954.9381895520405, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20312.1 146.8 length 4 5 16384 3793 4387 0 0 0.0 43637 64 chunk=8192 experts_streamed=103140", "tok_s": null, "gpu": {"0": {"util": 74.0, "power_w": 119.8, "n": 103}, "1": {"util": 77.4, "power_w": 122.6, "n": 103}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "default", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.46891308549708, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 32709, 3045, 30615, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 279, 5893, 557, 4574, 11, 65244, 539, 279, 14019, 4528, 314, 279, 17415, 13, 82697, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 11, 430, 413, 279, 8529, 998, 27044, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 24435, 7910, 300, 26112, 303, 279, 25348, 13, 26482, 279, 51624, 725, 30439, 11, 279, 3594, 557, 7948, 321, 82738, 314, 13254, 25588, 321, 38152, 86, 686, 13, 1216, 8826, 279, 16002, 383, 780, 36620, 17471, 11, 23221, 279, 24149, 77371, 314, 279, 8799, 27056, 13, 1690, 264, 1248, 854, 11, 551, 1066, 42578, 506, 424, 13, 1049], "info": "DONE 512 33 311.2 6208.4 length 258 461 0 330420 336811 0 0 0.0 33 122 chunk=0 experts_streamed=0", "sha": "6d21e457c493340d", "gpu": {"0": {"util": 43.9, "power_w": 120.9, "n": 33}, "1": {"util": 59.2, "power_w": 129.3, "n": 33}}}, {"kind": "code", "gen": 512, "tok_s": 102.04488380436084, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 311, 50123, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1353, 8339, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 13, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 13, 198, 406, 471, 10877, 3008, 25, 1379, 5742, 1429, 198, 406, 471, 34885, 3008, 25, 3140, 5742, 1429, 198, 262, 471, 54894, 7552, 318, 30358, 1901, 5350, 589, 8, 38406, 6607, 37208, 11256, 13, 271, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 4523, 869, 413, 1328, 6513, 11, 745, 471, 16, 13, 54704, 23975, 2357, 310, 1901, 13, 198, 262, 471, 2113, 4702, 11, 869, 1590, 47640, 14, 47989, 1328, 18509, 13, 1368, 8390, 32689, 11, 3514, 29015, 9495, 2357, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 271, 285, 653, 54894, 7552, 310, 5471, 819, 11988, 506, 22005, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 3110, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 3110, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829], "info": "DONE 512 36 290.0 5017.4 length 341 430 0 265230 277950 0 0 0.0 36 1386 chunk=0 experts_streamed=0", "sha": "4f739441d5e1da2f", "gpu": {"0": {"util": 38.7, "power_w": 120.6, "n": 26}, "1": {"util": 56.0, "power_w": 126.6, "n": 26}}}, {"kind": "facts", "gen": 480, "tok_s": 94.31181844974948, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 2532, 513, 7810, 31784, 303, 279, 12570, 1785, 2394, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 13, 198, 16, 23, 13, 561, 2943, 8906, 31784, 318, 25863, 24648, 11, 47334, 11, 8964, 11, 20403, 8, 513, 53653, 76663, 31784, 13, 198, 16, 24, 13, 561, 2943, 15484, 31784, 318, 41, 18925, 11, 47503, 11, 76925, 350, 11, 76879, 8, 513, 6605, 43701, 466, 9561, 43701, 13, 198, 17, 15, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 248046], "info": "DONE 480 37 384.5 5089.5 stop 314 433 0 258924 275313 0 0 0.0 37 1704 chunk=0 experts_streamed=0", "sha": "b081f1a6834a8dc4", "gpu": {"0": {"util": 44.7, "power_w": 118.7, "n": 28}, "1": {"util": 61.6, "power_w": 124.3, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1650.6515067666148, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9938.5 135.3 length 4 4 0 2505 3325 0 0 0.0 16405 167 chunk=8192 experts_streamed=35973", "tok_s": null, "gpu": {"0": {"util": 57.8, "power_w": 109.8, "n": 50}, "1": {"util": 52.7, "power_w": 109.2, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2961.367673179396, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20268.0 152.2 length 4 5 16384 3644 4335 0 0 0.0 43637 86 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 74.7, "power_w": 120.1, "n": 102}, "1": {"util": 77.7, "power_w": 123.1, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "pw2s0", "slots": "6594", "notes": ["strata generate: --pipeline-windows 2: 272 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 512, "tok_s": 72.01327744802947, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 6121, 5983, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 4613, 11, 85624, 2272, 279, 5445, 11, 557, 264, 21748, 6365, 314, 83132, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 13, 561, 8720, 557, 8981, 11, 47966, 440, 63993, 932, 13, 1216, 6316, 424, 888, 303, 780, 5888, 11, 36586, 279, 24544, 13, 561, 34830, 557, 41423, 11, 694, 33295, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 11, 874, 2321, 13, 4450, 279, 16002, 11, 279, 86249, 11, 321, 279, 21831, 2785, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780], "info": "DONE 512 33 265.0 7109.8 length 255 451 0 404996 412562 0 0 0.0 33 158 chunk=0 experts_streamed=0", "sha": "c73ddd5e21f78f86", "gpu": {"0": {"util": 85.3, "power_w": 134.6, "n": 37}, "1": {"util": 46.8, "power_w": 120.1, "n": 37}}}, {"kind": "code", "gen": 512, "tok_s": 94.28403064230996, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1328, 18054, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 440, 7703, 19537, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 1919, 7873, 79744, 496, 7, 16, 8, 854, 22373, 364, 2107, 615, 321, 2113, 7289, 198, 940, 264, 10286, 314, 264, 5010, 2336, 321, 264, 90651, 52589, 1103, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 16, 25, 5829, 3124, 318, 1891, 11048, 90651, 52589, 1103, 5313, 8, 198, 2, 15692, 10089, 198, 1005, 5829, 25, 198, 262, 4071, 198, 262, 37606, 264, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 1031, 262, 8618, 2357, 10220, 25, 198, 262, 471, 1328, 25, 279, 6297, 1328, 198, 262, 471, 869, 25, 279, 19954, 869, 198, 262, 471, 7624, 25, 7210, 310, 279, 3555, 2357, 318, 83, 79141, 436, 34810, 809, 8, 198, 262, 471, 1727, 25, 7210, 310, 279, 1727, 2357, 318, 83, 79141, 27412, 52, 809, 8, 198, 1031, 262, 561, 10278, 1103, 30941, 1906, 25, 198, 262, 471, 10877, 3008, 283, 7261, 39642, 11851, 318, 17896, 52, 8, 198, 262, 471, 34885, 3008, 283, 87401, 39642, 11851, 318, 19504, 52, 8, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 2, 15692, 10089, 198, 2, 6553, 220, 17, 25, 436, 34810, 18887, 3124, 318, 50342, 29806, 8, 198, 2, 15692, 10089, 198, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 1031, 262, 2791, 67678, 25, 198, 262, 471, 6297, 25, 6249, 12366, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 1901, 5350, 589, 25, 77991, 7552, 364, 279, 90651, 52589, 1103, 198, 406, 471, 1901, 4381, 3387, 310, 279, 27412, 52, 2357, 198, 406, 471, 9495, 28044, 3387, 310, 279, 436, 34810, 2357, 6987, 262, 24093, 25, 198, 262, 471, 615, 4702, 1590, 4523, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 27412, 52, 2234, 11, 745, 471, 16, 198, 262, 471, 2113, 4702, 11, 869, 1590, 47640, 14, 47989, 1328, 11, 10480, 310, 27412, 52, 11, 3514, 29015, 436, 34810, 413, 888, 8390, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 436, 34810, 6297, 440, 264, 2574, 8390, 13, 198, 1726, 285], "info": "DONE 512 36 249.8 5430.4 length 319 457 0 346525 360101 0 0 0.0 36 1157 chunk=0 experts_streamed=0", "sha": "4f12a62cf84a32c3", "gpu": {"0": {"util": 91.8, "power_w": 135.4, "n": 29}, "1": {"util": 55.3, "power_w": 122.1, "n": 29}}}, {"kind": "facts", "gen": 466, "tok_s": 90.91618542219447, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 11247, 3750, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 440, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 220, 23, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 561, 12570, 1785, 369, 12805, 220, 19, 13, 21, 6873, 1578, 2235, 13, 248046], "info": "DONE 466 37 339.3 5125.6 stop 297 428 0 305300 324918 0 0 0.0 37 2123 chunk=0 experts_streamed=0", "sha": "e81effdffbc1b1ca", "gpu": {"0": {"util": 88.3, "power_w": 134.7, "n": 27}, "1": {"util": 58.7, "power_w": 121.2, "n": 27}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1593.3217431843125, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 10296.1 151.8 length 4 4 0 2758 3712 0 0 0.0 16405 174 chunk=8192 experts_streamed=36896", "tok_s": null, "gpu": {"0": {"util": 67.9, "power_w": 111.0, "n": 52}, "1": {"util": 56.6, "power_w": 107.7, "n": 52}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2823.4679813151815, "ids": [2495, 450, 16545, 799, 1622, 506, 264, 854], "info": "DONE 8 60021 21257.9 121.6 length 4 4 16384 3646 4278 0 0 0.0 43637 105 chunk=8192 experts_streamed=104532", "tok_s": null, "gpu": {"0": {"util": 60.3, "power_w": 120.9, "n": 107}, "1": {"util": 74.6, "power_w": 120.8, "n": 107}}, "sha": "56ca29a619f7cd8d"}]}
+{"round": 4, "arm": "pw1", "slots": "7238", "notes": ["strata generate: --pipeline-windows 1: 160 MiB of CUDA0 kept out of the expert cache (the second verifier)", "strata serve: --pipeline-windows 1: two verifiers per stage, 2 stages overlap across windows"], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.87069258533901, "ids": [760, 29262, 506, 5068, 6451, 4963, 1467, 524, 15756, 38225, 26, 424, 61551, 13, 1049, 61199, 279, 32946, 11, 279, 9117, 11, 321, 279, 12515, 11, 9101, 1132, 279, 27163, 20569, 11, 21461, 50355, 314, 279, 324, 55965, 321, 279, 55218, 6851, 314, 82697, 645, 16413, 13, 271, 36, 69388, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 551, 47158, 13, 2332, 50614, 36165, 11, 780, 6574, 557, 17032, 290, 539, 11679, 321, 9662, 11, 780, 5888, 10841, 430, 32524, 6451, 11, 321, 780, 6213, 279, 1829, 314, 279, 13071, 88, 21678, 13, 1216, 995, 8341, 279, 3000, 364, 25292, 1578, 11, 264, 37671, 748, 1248, 421, 279, 2136, 70704, 874, 4860, 5312, 1384, 430, 264, 1637, 11, 694, 430, 264, 4416, 314, 279, 17865, 11, 430, 14884, 321, 5689, 430, 279, 49577, 4924, 13, 271, 15514, 13618, 557, 264, 12647, 59452, 314, 95041, 13, 39235, 506, 220, 19, 25, 15, 15, 6556, 13, 4109, 279, 5415, 5684, 13, 30931, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 13, 12194, 279, 44798, 314, 279, 17507, 11, 13879, 364, 279, 10174, 276, 314, 279, 10679, 88663, 466, 279, 15268, 314, 264, 338, 602, 13, 4844, 11, 52736, 279, 39740, 59678, 11, 7923, 264, 16976, 314, 2503, 83, 463, 321, 3619, 10482, 11, 321, 3655, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 948, 279, 40297, 42046, 998, 6941, 310, 40613, 1029, 279, 12515, 11, 421, 279, 13618, 14009, 13, 271, 36, 69388, 557, 11107, 279, 4570, 10994, 11, 264, 14590, 12931, 314, 542, 2104, 421, 10641, 1881, 279, 2255, 314, 279, 324, 55965, 321, 279, 509, 51554, 9117, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 264, 14084, 314, 9002, 5802, 7920, 23221, 279, 16382, 13, 1216, 557, 3221, 364, 9117, 8720, 11, 264, 30490, 551, 995, 4284, 685, 303, 780, 2843, 1578, 310, 2426, 780, 3838, 494, 12680, 59833, 2166, 43859, 13, 1216, 45867, 279, 13988, 25374, 11, 780, 24435, 40356, 286, 54166, 11, 948, 2414, 10255, 279, 33443, 10806, 314, 780, 2047, 7662, 13, 271, 2064, 557, 524, 8720, 13, 1049, 557, 264, 16002, 13, 271, 2064, 10641, 4139, 1402, 322, 1086, 303, 279, 13988, 9002, 11, 82951, 506, 449, 8937, 11, 430, 413, 424, 995, 978, 8826, 1017, 440, 2373, 4598, 1056, 36251, 685, 539, 5823, 13, 82697, 23928, 424, 11, 780, 38896, 280, 4850, 290, 13, 1049, 557, 264, 6121, 5983, 8720, 16002, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 16829, 440, 4242, 472, 13, 561, 4242, 472, 557, 245744, 290, 11, 91380, 11, 694, 279, 34830, 24544, 14195, 33295, 13, 271, 1465, 12405, 424, 685, 13, 1049, 557, 8545, 11, 9896, 440, 2414, 975, 1056, 2919, 13, 1216, 6316, 424, 888, 303, 780, 5888, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 279, 10558, 11, 8981, 15196, 314, 279, 8720, 13, 271, 36, 69388, 11354, 424, 1142, 310, 279, 324, 55965, 11, 23294, 424, 383, 279, 9488, 1898, 13, 1216, 7338, 364, 264, 1248, 854, 11, 35556, 506, 424, 13], "info": "DONE 512 33 243.7 6178.3 length 261 434 0 315807 322955 0 0 0.0 33 198 chunk=0 experts_streamed=0", "sha": "7f199e4e8de74f5b", "gpu": {"0": {"util": 44.7, "power_w": 122.5, "n": 32}, "1": {"util": 60.2, "power_w": 130.4, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 100.05862810240374, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 25, 16782, 1901, 321, 9495, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 7261, 5742, 1429, 3008, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 87401, 5742, 1429, 3008, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285, 7624, 4922, 283], "info": "DONE 512 36 240.5 5117.0 length 345 444 0 268112 282571 0 0 0.0 36 1595 chunk=0 experts_streamed=0", "sha": "ce5578741a2f7c1a", "gpu": {"0": {"util": 44.3, "power_w": 119.7, "n": 27}, "1": {"util": 62.7, "power_w": 127.6, "n": 27}}}, {"kind": "facts", "gen": 500, "tok_s": 92.94025800215621, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 31784, 11, 4483, 220, 17, 19, 18, 8964, 2756, 310, 4434, 799, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 11, 440, 220, 22, 16, 4, 314, 1141, 7099, 9469, 539, 2919, 13, 198, 21, 13, 8964, 682, 799, 5629, 22486, 11, 279, 16820, 11, 864, 369, 220, 18, 23, 19, 11, 19, 15, 15, 12754, 3023, 383, 5289, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 15333, 11, 440, 264, 22315, 314, 220, 21, 11, 22, 22, 24, 12754, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 7526, 25, 28686, 11, 37222, 11, 47437, 1544, 14880, 11, 321, 6920, 24534, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 682, 220, 17, 22, 3750, 77396, 11, 660, 6725, 1238, 5587, 494, 40014, 321, 28400, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 11, 7172, 883, 220, 19, 13, 20, 6873, 12754, 3023, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 4016, 310, 1141, 7652, 310, 2708, 1141, 62409, 12174, 13, 198, 16, 23, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 16, 24, 13, 42120, 682, 279, 37847, 1007, 11, 25720, 449, 25659, 2094, 279, 7806, 303, 1066, 220, 23, 23, 8964, 2756, 13, 198, 17, 15, 13, 76879, 557, 279, 1118, 11247, 10782, 1472, 34780, 19039, 4598, 1056, 2050, 21254, 303, 220, 16, 23, 19, 21, 13, 248046], "info": "DONE 500 37 317.7 5379.8 stop 324 448 0 269274 286484 0 0 0.0 37 1741 chunk=0 experts_streamed=0", "sha": "d1adfdb5832225c3", "gpu": {"0": {"util": 53.8, "power_w": 118.5, "n": 29}, "1": {"util": 66.8, "power_w": 125.8, "n": 29}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1646.5758649416346, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9963.1 141.5 length 4 4 0 2429 3316 0 0 0.0 16405 174 chunk=8192 experts_streamed=36426", "tok_s": null, "gpu": {"0": {"util": 65.7, "power_w": 109.6, "n": 50}, "1": {"util": 62.0, "power_w": 110.8, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2960.6665088196996, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 60021 20272.8 149.2 length 3 4 16384 3191 3857 0 0 0.0 43637 94 chunk=8192 experts_streamed=103140", "tok_s": null, "gpu": {"0": {"util": 75.0, "power_w": 120.3, "n": 102}, "1": {"util": 77.9, "power_w": 122.8, "n": 102}}, "sha": "84d46cd5a99fc0a9"}]}
+{"round": 4, "arm": "default2", "slots": "7342", "notes": [], "rows": [{"kind": "story", "gen": 512, "tok_s": 82.8760582074815, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 421, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 279, 20319, 998, 9522, 28051, 314, 11228, 321, 79808, 13, 271, 2064, 557, 383, 264, 7348, 303, 3200, 6324, 11, 2261, 264, 13071, 421, 995, 76911, 279, 13255, 364, 2250, 2756, 11, 421, 279, 13618, 14009, 13, 271, 760, 9662, 995, 8209, 1441, 310, 264, 57135, 1218, 33700, 11, 694, 279, 9117, 14195, 509, 51554, 11, 264, 50240, 17024, 18594, 314, 30065, 321, 32871, 13, 82697, 557, 11107, 279, 44798, 314, 279, 53653, 10994, 3559, 279, 324, 55965, 11, 12910, 364, 5383, 310, 279, 15787, 13, 561, 40554, 557, 54900, 3238, 11, 44431, 25888, 3438, 22317, 421, 5802, 10641, 81179, 13, 1577, 551, 45867, 279, 94682, 11, 264, 2682, 390, 314, 2414, 77959, 10255, 780, 7662, 13, 1049, 5532, 1357, 279, 39192, 31335, 314, 13988, 9506, 466, 279, 4022, 7960, 314, 14293, 16382, 13, 1049, 557, 264, 16724, 11, 50717, 21172, 13, 271, 1465, 23928, 88239, 13, 6318, 3438, 1881, 1330, 31253, 7653, 12, 924, 81, 26271, 292, 601, 382, 11, 4139, 1402, 322, 1086, 303, 264, 1678, 38535, 314, 580, 1222, 321, 9002, 11, 557, 264, 16002, 13, 271, 2064, 557, 524, 264, 6278, 11840, 5303, 11, 6130, 264, 5129, 12701, 16002, 13, 1049, 557, 264, 11702, 11, 6121, 5983, 8720, 25347, 11, 18473, 440, 264, 86249, 421, 995, 978, 34830, 290, 321, 18880, 303, 4242, 472, 13, 561, 8720, 557, 9158, 290, 440, 4092, 11, 694, 4613, 11, 85624, 2272, 279, 5445, 11, 557, 264, 21748, 6365, 314, 83132, 13, 271, 36, 69388, 12405, 424, 685, 13, 1049, 557, 42371, 1056, 551, 3481, 13, 561, 8720, 557, 8981, 11, 47966, 440, 63993, 932, 13, 1216, 6316, 424, 888, 303, 780, 5888, 11, 36586, 279, 24544, 13, 561, 34830, 557, 41423, 11, 694, 33295, 13, 2532, 557, 874, 2306, 11, 874, 13562, 725, 1804, 13, 4450, 279, 16002, 11, 279, 86249, 11, 321, 279, 21831, 2785, 13, 271, 1465, 11354, 424, 1142, 310, 279, 324, 55965, 11, 780, 4593, 25315, 264, 14457, 11, 39943, 35091, 2272, 780, 53295, 13, 733], "info": "DONE 512 33 314.0 6177.9 length 260 450 0 323885 330443 0 0 0.0 33 128 chunk=0 experts_streamed=0", "sha": "e02703b5d65f5fa2", "gpu": {"0": {"util": 46.7, "power_w": 121.9, "n": 32}, "1": {"util": 59.8, "power_w": 129.3, "n": 32}}}, {"kind": "code", "gen": 512, "tok_s": 99.84009984009984, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1061, 7873, 5533, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 364, 496, 7, 16, 8, 2528, 14, 4069, 289, 321, 264, 2972, 8038, 2336, 332, 364, 496, 7, 16, 8, 1353, 8339, 13, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514, 283, 220, 15, 1590, 198, 285, 638, 4582, 283, 1328, 198, 285, 638, 2733, 283, 869, 198, 285, 638, 28044, 283, 2168, 198, 285, 638, 4381, 283, 2168, 1358, 1005, 43072, 5287, 1714, 25, 198, 262, 4071, 198, 262, 436, 34810, 18887, 440, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 271, 262, 27662, 25, 198, 262, 471, 6328, 2336, 318, 8217, 1590, 13640, 1328, 1411, 5829, 364, 496, 7, 16, 8, 18054, 198, 262, 471, 53019, 391, 52589, 1103, 25, 30941, 2528, 1906, 318, 3444, 3110, 506, 1901, 11, 198, 406, 3140, 3110, 506, 9495, 8, 271, 262, 54894, 7552, 318, 30358, 1901, 321, 9495, 8, 38406, 6607, 37208, 11256, 198, 262, 539, 38192, 819, 11988, 364, 7624, 14, 3480, 26564, 13, 198, 262, 4071, 271, 262, 687, 1259, 2251, 3676, 701, 11, 8390, 25, 514, 1590, 198, 285, 4071, 198, 285, 8736, 279, 6297, 440, 264, 2574, 8390, 13, 271, 285, 17167, 25, 198, 309, 8390, 25, 25749, 1324, 314, 3470, 279, 6297, 628, 3222, 13, 198, 2467, 15011, 381, 264, 6572, 7308, 13, 198, 285, 4071, 198, 285, 413, 8390, 2564, 220, 15, 25, 198, 309, 4673, 14953, 437, 28432, 1902, 381, 264, 6572, 7308, 871, 271, 285, 638, 57167, 283, 8390, 198, 285, 638, 19474, 283, 4535, 220, 653, 1328, 1411, 5829, 12366, 364, 496, 7, 16, 8, 18054, 271, 285, 653, 54894, 7552, 310, 38406, 10278, 1103, 7289, 198, 285, 638, 15569, 283, 5829, 363, 220, 653, 16782, 1901, 318, 3444, 5742, 1429, 3008, 8, 198, 285, 638, 37429, 283, 5829, 363, 220, 653, 16782, 9495, 318, 53415, 5742, 1429, 3008, 8, 198, 285, 638, 15569, 4381, 283, 638, 37429, 198, 285, 638, 37429, 28044, 283, 638, 15569, 271, 262, 687, 696, 5231, 1153, 11, 2357, 25, 5829, 8, 1411, 2168, 25, 198, 285, 4071, 198, 285, 10466, 264, 2357, 494, 279, 90651, 52589, 1103, 13, 271, 285, 17167, 25, 198, 309, 2357, 25, 561, 2357, 310, 3921, 13, 198, 285, 4071, 198, 285], "info": "DONE 512 36 295.2 5128.2 length 341 444 0 270620 284091 0 0 0.0 36 1543 chunk=0 experts_streamed=0", "sha": "63a88930785d854a", "gpu": {"0": {"util": 44.0, "power_w": 119.3, "n": 27}, "1": {"util": 57.5, "power_w": 126.8, "n": 27}}}, {"kind": "facts", "gen": 476, "tok_s": 92.33574518438051, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24, 11, 23, 17, 15, 12754, 13, 198, 16, 15, 13, 48017, 682, 506, 3140, 220, 24, 20, 3750, 77396, 11, 2583, 279, 2943, 3349, 10305, 448, 276, 77396, 13, 198, 16, 16, 13, 47503, 369, 10919, 364, 1141, 19845, 9761, 1785, 11, 864, 42824, 685, 310, 220, 17, 23, 17, 11, 15, 15, 15, 12754, 303, 22315, 13, 198, 16, 17, 13, 47503, 369, 279, 3140, 27044, 11247, 11, 440, 264, 16940, 314, 220, 15, 13, 21, 23, 22, 338, 66853, 41776, 11, 7063, 424, 1000, 2153, 303, 2919, 13, 198, 16, 18, 13, 76925, 350, 85993, 383, 1141, 3008, 440, 449, 93829, 35003, 314, 220, 24, 23, 11995, 13, 198, 16, 19, 13, 76925, 350, 557, 279, 1118, 11247, 10782, 1608, 264, 53952, 303, 220, 16, 22, 23, 16, 539, 12021, 62193, 232364, 13, 198, 16, 20, 13, 76879, 369, 279, 2944, 58793, 11247, 494, 279, 7806, 506, 449, 5289, 5821, 314, 220, 19, 13, 20, 6873, 12754, 13, 198, 16, 21, 13, 76879, 682, 279, 28928, 27562, 303, 279, 12570, 1785, 11, 18176, 23944, 314, 220, 17, 11, 16, 15, 15, 12754, 7294, 13, 198, 16, 22, 13, 74926, 557, 311, 62680, 430, 264, 47797, 11247, 303, 220, 17, 15, 15, 21, 539, 279, 6953, 37237, 13865, 908, 8872, 13, 198, 16, 23, 13, 2532, 513, 7810, 3813, 31784, 303, 279, 12570, 1785, 11, 23245, 494, 42120, 310, 76879, 13, 198, 16, 24, 13, 561, 7806, 9331, 364, 220, 24, 24, 13, 23, 21, 4, 314, 279, 2702, 2973, 314, 279, 12570, 1785, 13, 198, 17, 15, 13, 1942, 31784, 25659, 279, 7806, 303, 75124, 908, 12351, 11, 440, 42120, 3322, 279, 37847, 1007, 506, 220, 23, 23, 8964, 2756, 13, 248046], "info": "DONE 476 37 390.9 5155.1 stop 310 413 0 247954 265279 0 0 0.0 37 1948 chunk=0 experts_streamed=0", "sha": "c28d387b00ba4408", "gpu": {"0": {"util": 46.6, "power_w": 116.9, "n": 28}, "1": {"util": 54.1, "power_w": 124.9, "n": 28}}}, {"kind": "pp16k", "pp_tokens": 16405, "pp_tok_s": 1644.4137046169883, "ids": [2495, 450, 369, 264, 2136, 436, 10673, 4560], "info": "DONE 8 16405 9976.2 137.7 length 4 4 0 2515 3344 0 0 0.0 16405 161 chunk=8192 experts_streamed=35923", "tok_s": null, "gpu": {"0": {"util": 56.6, "power_w": 110.1, "n": 50}, "1": {"util": 65.1, "power_w": 109.9, "n": 50}}, "sha": "84d46cd5a99fc0a9"}, {"kind": "pp58k", "pp_tokens": 60021, "pp_tok_s": 2957.5882408014227, "ids": [2495, 450, 16545, 7154, 799, 506, 264, 854], "info": "DONE 8 60021 20293.9 143.5 length 4 4 16384 3389 3954 0 0 0.0 43637 73 chunk=8192 experts_streamed=101970", "tok_s": null, "gpu": {"0": {"util": 74.8, "power_w": 119.7, "n": 103}, "1": {"util": 83.5, "power_w": 122.3, "n": 103}}, "sha": "07313010a2a7da94"}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1b-single/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1b-single/summary.txt
new file mode 100644
index 000000000..b486e705f
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p1b-single/summary.txt
@@ -0,0 +1,54 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | story:tok_s | 82.48 | 1.000 | 0/5 | 5
+pw2s0 | story:tok_s | 71.63 | 0.868 | 0/5 | 5
+pw1 | story:tok_s | 81.30 | 0.986 | 1/5 | 5
+default2 | story:tok_s | 82.15 | 0.996 | 1/5 | 5
+default | code:tok_s | 99.91 | 1.000 | 0/5 | 5
+pw2s0 | code:tok_s | 94.46 | 0.945 | 1/5 | 5
+pw1 | code:tok_s | 99.55 | 0.996 | 3/5 | 5
+default2 | code:tok_s | 99.84 | 0.999 | 2/5 | 5
+default | facts:tok_s | 94.31 | 1.000 | 0/5 | 5
+pw2s0 | facts:tok_s | 87.63 | 0.929 | 0/5 | 5
+pw1 | facts:tok_s | 92.94 | 0.985 | 2/5 | 5
+default2 | facts:tok_s | 92.34 | 0.979 | 2/5 | 5
+default | pp16k:pp_tok_s | 1650.65 | 1.000 | 0/5 | 5
+pw2s0 | pp16k:pp_tok_s | 1593.72 | 0.966 | 0/5 | 5
+pw1 | pp16k:pp_tok_s | 1646.58 | 0.998 | 1/5 | 5
+default2 | pp16k:pp_tok_s | 1646.89 | 0.998 | 1/5 | 5
+default | pp58k:pp_tok_s | 2961.37 | 1.000 | 0/5 | 5
+pw2s0 | pp58k:pp_tok_s | 2823.47 | 0.953 | 0/5 | 5
+pw1 | pp58k:pp_tok_s | 2954.94 | 0.998 | 2/5 | 5
+default2 | pp58k:pp_tok_s | 2957.59 | 0.999 | 1/5 | 5
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | story | gpu0 45, gpu1 58 | 121, 129 | 48
+default | code | gpu0 42, gpu1 59 | 120, 127 | 49
+default | facts | gpu0 45, gpu1 61 | 118, 125 | 47
+default | pp16k | gpu0 57, gpu1 60 | 109, 109 | 41
+default | pp58k | gpu0 75, gpu1 78 | 120, 123 | 24
+pw2s0 | story | gpu0 78, gpu1 48 | 134, 120 | 37
+pw2s0 | code | gpu0 88, gpu1 57 | 135, 120 | 28
+pw2s0 | facts | gpu0 88, gpu1 64 | 135, 121 | 24
+pw2s0 | pp16k | gpu0 68, gpu1 58 | 111, 107 | 37
+pw2s0 | pp58k | gpu0 69, gpu1 75 | 121, 120 | 28
+pw1 | story | gpu0 45, gpu1 59 | 123, 131 | 48
+pw1 | code | gpu0 45, gpu1 61 | 120, 128 | 47
+pw1 | facts | gpu0 47, gpu1 62 | 119, 125 | 45
+pw1 | pp16k | gpu0 61, gpu1 62 | 109, 110 | 38
+pw1 | pp58k | gpu0 74, gpu1 77 | 120, 123 | 24
+default2 | story | gpu0 44, gpu1 60 | 122, 128 | 48
+default2 | code | gpu0 45, gpu1 58 | 120, 127 | 49
+default2 | facts | gpu0 45, gpu1 58 | 119, 125 | 49
+default2 | pp16k | gpu0 57, gpu1 64 | 110, 110 | 40
+default2 | pp58k | gpu0 76, gpu1 82 | 120, 123 | 21
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+story: 18 distinct -> 1411a2a700d145ff:default; 1b105ccf96e69ba0:pw2s0; 5fee251b62c70822:pw1; 3ed28dd532e318fa:default2; cdc6511981fd6e8c:pw2s0; 49fbed07560bcab3:pw1; da12ccce0593f5b4:default2; d8a295c262921617:default; 5ca2d9d4411ea45d:pw1; afd22e324d2d9940:default2; 008dccf84b36532a:default,default2; be748469b6dbf0b6:pw2s0; 6d21e457c493340d:default; f110daae9f30821e:pw2s0; 4fe92a6e4e5ed327:pw1; c73ddd5e21f78f86:pw2s0; 7f199e4e8de74f5b:pw1; e02703b5d65f5fa2:default2
+code: 18 distinct -> 14d88a4c13be63b7:default,pw2s0; c42a369374eb8e8b:pw2s0; ce5578741a2f7c1a:pw1; 7a858dbde4437279:default2; 59c29287129a1108:pw1; 1199e5b1769e4630:default2; 610d88fa9f502690:default; e738aaf2957f824f:pw1; 312de79b868099ca:default2; bc30fe07ca8e50d3:default; 47ca0a02fa65b579:pw2s0; e3d15a74b1c3bcaa:default2; c1bbb731e33f6901:default; da0f0d0ae458a0f0:pw2s0; d0ef62ad571aa5e8:pw1; 4f739441d5e1da2f:default; 4f12a62cf84a32c3:pw2s0; 63a88930785d854a:default2
+facts: 20 distinct -> 1f49d91321c78079:default; cb82ba092887d71a:pw2s0; a4f5aa2f602f4523:pw1; 1491bd4b6892fc12:default2; 1b8a5ad32ac6ee89:pw2s0; 063dcd7ffe616f19:pw1; d7638c129a00155d:default2; 90493fa673d32422:default; 08b8a67f7c0f8441:pw1; 058e2202fc7e53c6:default2; 1f884adfc9a80ad5:default; 6d36f714d54583b0:pw2s0; 83061dd58b8fb934:default2; 322511ecf38cdf2a:default; 1d386e2f4b3d33ee:pw2s0; d2ca1951ddc13250:pw1; b081f1a6834a8dc4:default; e81effdffbc1b1ca:pw2s0; d1adfdb5832225c3:pw1; c28d387b00ba4408:default2
+pp16k: 2 distinct -> 84d46cd5a99fc0a9:default,default2,pw1,pw2s0; 3a17b0b54df13952:default,pw1
+pp58k: 3 distinct -> 84d46cd5a99fc0a9:default,default2,pw1,pw2s0; 56ca29a619f7cd8d:pw1,pw2s0; 07313010a2a7da94:default2
+default: expert-cache slots ['7342']
+pw2s0: expert-cache slots ['6594']
+pw1: expert-cache slots ['7238']
+default2: expert-cache slots ['7342']
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2-exact/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2-exact/results.jsonl
new file mode 100644
index 000000000..53ce78fd5
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2-exact/results.jsonl
@@ -0,0 +1,4 @@
+{"round": 0, "arm": "default", "slots": "2246", "notes": [], "rows": [{"kind": "story", "gen": 192, "tok_s": 22.207828259461458, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 191.3 8645.6 length 98 175 26 43352 129600 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 56.8, "power_w": 81.4, "n": 44}, "1": {"util": 38.5, "power_w": 91.8, "n": 44}}}, {"kind": "code", "gen": 192, "tok_s": 33.48097513340076, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198], "info": "DONE 192 36 817.9 5734.6 length 116 178 0 73981 123360 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "62d390ae86cf9cb7", "gpu": {"0": {"util": 66.6, "power_w": 89.0, "n": 33}, "1": {"util": 32.1, "power_w": 82.0, "n": 33}}}, {"kind": "facts", "gen": 192, "tok_s": 28.07386936877659, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 915.1 6839.1 length 126 162 0 40104 109440 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 61.8, "power_w": 84.2, "n": 38}, "1": {"util": 39.1, "power_w": 84.8, "n": 38}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 949.3174691016417, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4336.8 239.2 length 4 8 0 3950 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18406", "tok_s": null, "gpu": {"0": {"util": 37.0, "power_w": 88.9, "n": 23}, "1": {"util": 39.1, "power_w": 78.6, "n": 23}}, "sha": "6b7941777809adb9"}]}
+{"round": 0, "arm": "overlap", "slots": "2246", "notes": ["strata serve: layer split: layers 0-24 (CUDA0), 25-47 (CUDA1), one hand-off per window (overlapped: STRATA_SPLIT_OVERLAP=1)"], "rows": [{"kind": "story", "gen": 192, "tok_s": 22.34740909725779, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 192.7 8591.6 length 98 175 26 43352 129600 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 57.3, "power_w": 79.1, "n": 44}, "1": {"util": 97.2, "power_w": 94.9, "n": 44}}}, {"kind": "code", "gen": 192, "tok_s": 34.66517413833571, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198], "info": "DONE 192 36 823.1 5538.7 length 116 178 0 73981 123360 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "62d390ae86cf9cb7", "gpu": {"0": {"util": 67.1, "power_w": 87.6, "n": 32}, "1": {"util": 97.1, "power_w": 101.8, "n": 32}}}, {"kind": "facts", "gen": 192, "tok_s": 28.556555365509038, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 898.4 6723.5 length 126 162 0 40104 109440 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 55.3, "power_w": 83.3, "n": 38}, "1": {"util": 97.4, "power_w": 99.7, "n": 38}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 946.3280082749109, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4350.5 236.0 length 4 8 0 3950 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18406", "tok_s": null, "gpu": {"0": {"util": 43.5, "power_w": 94.4, "n": 23}, "1": {"util": 55.1, "power_w": 95.2, "n": 23}}, "sha": "6b7941777809adb9"}]}
+{"round": 0, "arm": "pw2", "slots": "2246", "notes": ["strata generate: note: --pipeline-windows 2 on a layer split of two stages without the draft layer on the first card (STRATA_MTP_STAGE0=1 asks for it): the draft chain then shares the last card with its window and the pipeline lost to the serial loop on 2x R9700 before 0.1.44 (docs/MULTI_GPU.md); kept as asked, --pipeline-windows 0 turns it off", "strata generate: --pipeline-windows 2: 278 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 192, "tok_s": 18.743959466187654, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 178.3 10243.3 length 97 169 26 49123 160970 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 93.0, "power_w": 86.9, "n": 52}, "1": {"util": 59.0, "power_w": 90.9, "n": 52}}}, {"kind": "code", "gen": 192, "tok_s": 29.09487657407828, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514], "info": "DONE 192 36 709.0 6599.1 length 118 180 0 80068 149600 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "871f23cd8466886b", "gpu": {"0": {"util": 92.3, "power_w": 95.9, "n": 37}, "1": {"util": 52.9, "power_w": 100.2, "n": 37}}}, {"kind": "facts", "gen": 192, "tok_s": 23.40464435911501, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 796.8 8203.5 length 118 179 0 50051 142890 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 87.3, "power_w": 89.8, "n": 45}, "1": {"util": 68.6, "power_w": 97.8, "n": 45}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 962.1856595307096, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4278.8 257.3 length 4 8 0 4169 6220 0 0 0.0 4117 0 chunk=4110 experts_streamed=18493", "tok_s": null, "gpu": {"0": {"util": 48.5, "power_w": 97.3, "n": 22}, "1": {"util": 49.8, "power_w": 93.9, "n": 22}}, "sha": "6b7941777809adb9"}]}
+{"round": 0, "arm": "default2", "slots": "2246", "notes": [], "rows": [{"kind": "story", "gen": 192, "tok_s": 22.47427748709485, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 188.1 8543.1 length 98 175 26 43352 129600 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 57.6, "power_w": 78.3, "n": 44}, "1": {"util": 40.0, "power_w": 87.3, "n": 44}}}, {"kind": "code", "gen": 192, "tok_s": 34.57590491626148, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198], "info": "DONE 192 36 803.0 5553.0 length 116 178 0 73981 123360 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "62d390ae86cf9cb7", "gpu": {"0": {"util": 68.4, "power_w": 86.6, "n": 31}, "1": {"util": 32.0, "power_w": 78.1, "n": 31}}}, {"kind": "facts", "gen": 192, "tok_s": 28.75026204665928, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 898.6 6678.2 length 126 162 0 40104 109440 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 57.0, "power_w": 82.1, "n": 38}, "1": {"util": 37.0, "power_w": 80.6, "n": 38}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 951.0059827677807, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4329.1 243.3 length 4 8 0 3950 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18406", "tok_s": null, "gpu": {"0": {"util": 43.5, "power_w": 95.6, "n": 23}, "1": {"util": 48.9, "power_w": 90.7, "n": 23}}, "sha": "6b7941777809adb9"}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2-exact/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2-exact/summary.txt
new file mode 100644
index 000000000..58d920d84
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2-exact/summary.txt
@@ -0,0 +1,45 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | story:tok_s | 22.21 | 1.000 | 0/1 | 1
+overlap | story:tok_s | 22.35 | 1.006 | 1/1 | 1
+pw2 | story:tok_s | 18.74 | 0.844 | 0/1 | 1
+default2 | story:tok_s | 22.47 | 1.012 | 1/1 | 1
+default | code:tok_s | 33.48 | 1.000 | 0/1 | 1
+overlap | code:tok_s | 34.67 | 1.035 | 1/1 | 1
+pw2 | code:tok_s | 29.09 | 0.869 | 0/1 | 1
+default2 | code:tok_s | 34.58 | 1.033 | 1/1 | 1
+default | facts:tok_s | 28.07 | 1.000 | 0/1 | 1
+overlap | facts:tok_s | 28.56 | 1.017 | 1/1 | 1
+pw2 | facts:tok_s | 23.40 | 0.834 | 0/1 | 1
+default2 | facts:tok_s | 28.75 | 1.024 | 1/1 | 1
+default | pp4k:pp_tok_s | 949.32 | 1.000 | 0/1 | 1
+overlap | pp4k:pp_tok_s | 946.33 | 0.997 | 0/1 | 1
+pw2 | pp4k:pp_tok_s | 962.19 | 1.014 | 1/1 | 1
+default2 | pp4k:pp_tok_s | 951.01 | 1.002 | 1/1 | 1
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | story | gpu0 57, gpu1 38 | 81, 92 | 52
+default | code | gpu0 67, gpu1 32 | 89, 82 | 51
+default | facts | gpu0 62, gpu1 39 | 84, 85 | 50
+default | pp4k | gpu0 37, gpu1 39 | 89, 79 | 62
+overlap | story | gpu0 57, gpu1 97 | 79, 95 | 23
+overlap | code | gpu0 67, gpu1 97 | 88, 102 | 18
+overlap | facts | gpu0 55, gpu1 97 | 83, 100 | 24
+overlap | pp4k | gpu0 44, gpu1 55 | 94, 95 | 51
+pw2 | story | gpu0 93, gpu1 59 | 87, 91 | 24
+pw2 | code | gpu0 92, gpu1 53 | 96, 100 | 27
+pw2 | facts | gpu0 87, gpu1 69 | 90, 98 | 22
+pw2 | pp4k | gpu0 48, gpu1 50 | 97, 94 | 51
+default2 | story | gpu0 58, gpu1 40 | 78, 87 | 51
+default2 | code | gpu0 68, gpu1 32 | 87, 78 | 50
+default2 | facts | gpu0 57, gpu1 37 | 82, 81 | 53
+default2 | pp4k | gpu0 44, gpu1 49 | 96, 91 | 54
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+story: 1 distinct
+code: 2 distinct -> 62d390ae86cf9cb7:default,default2,overlap; 871f23cd8466886b:pw2
+facts: 1 distinct
+pp4k: 1 distinct
+default: expert-cache slots ['2246']
+overlap: expert-cache slots ['2246']
+pw2: expert-cache slots ['2246']
+default2: expert-cache slots ['2246']
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2b-exact/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2b-exact/results.jsonl
new file mode 100644
index 000000000..f70031a62
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2b-exact/results.jsonl
@@ -0,0 +1,4 @@
+{"round": 0, "arm": "default", "slots": "2246", "notes": [], "rows": [{"kind": "story", "gen": 192, "tok_s": 22.564874012786763, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 189.0 8508.8 length 98 175 26 43352 129600 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 60.8, "power_w": 79.8, "n": 44}, "1": {"util": 38.7, "power_w": 89.9, "n": 44}}}, {"kind": "code", "gen": 192, "tok_s": 34.464189553042544, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198], "info": "DONE 192 36 806.1 5571.0 length 116 178 0 73981 123360 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "62d390ae86cf9cb7", "gpu": {"0": {"util": 63.2, "power_w": 88.1, "n": 32}, "1": {"util": 27.4, "power_w": 81.1, "n": 32}}}, {"kind": "facts", "gen": 192, "tok_s": 28.407829908118426, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 934.3 6758.7 length 126 162 0 40104 109440 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 62.9, "power_w": 83.5, "n": 38}, "1": {"util": 39.4, "power_w": 85.4, "n": 38}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 948.2679196609544, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4341.6 237.8 length 4 8 0 3950 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18406", "tok_s": null, "gpu": {"0": {"util": 33.2, "power_w": 89.2, "n": 23}, "1": {"util": 45.0, "power_w": 77.9, "n": 23}}, "sha": "6b7941777809adb9"}]}
+{"round": 0, "arm": "pw2s0", "slots": "2282", "notes": ["strata generate: --pipeline-windows 2: 272 MiB of CUDA0 kept out of the expert cache (the second verifier, the GDN snapshots)", "strata serve: --pipeline-windows 2: two verifiers per stage, 2 stages overlap across windows (decode too; the GDN snapshots beside the window)"], "rows": [{"kind": "story", "gen": 192, "tok_s": 19.060288088312667, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 20413, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 279, 338, 68042, 11, 310, 279, 9662, 11, 321, 22217, 310, 279, 19261, 314, 780, 7168, 11, 49159, 11, 852, 995, 5642, 4097, 1578, 4711, 11, 9101, 1384, 440, 4161, 694, 279], "info": "DONE 192 33 171.5 10073.3 length 95 160 26 50825 161550 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "299740b746d9ce42", "gpu": {"0": {"util": 86.9, "power_w": 96.6, "n": 51}, "1": {"util": 49.6, "power_w": 83.4, "n": 51}}}, {"kind": "code", "gen": 192, "tok_s": 32.514817950889075, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 948, 8390, 369, 32689, 13, 198, 66631, 264, 90651, 52589, 1103, 478, 5010, 2336, 364, 496, 7, 16, 8, 615, 321, 2113, 7289, 13, 198, 12237, 271, 1445, 14856, 1120, 51425, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279, 90651, 52589, 1103, 13, 198, 262, 8618, 2357, 10220, 264, 1328, 18509, 6505, 321, 26564, 310, 7624, 14, 3480, 7552, 13, 198, 262, 4071, 198, 262, 687, 1259, 2251, 3676, 701, 11, 1328, 25, 514, 283, 220, 15, 11, 869, 25, 514], "info": "DONE 192 36 660.2 5905.0 length 120 173 0 80796 142810 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "871f23cd8466886b", "gpu": {"0": {"util": 93.5, "power_w": 106.0, "n": 33}, "1": {"util": 62.8, "power_w": 94.2, "n": 33}}}, {"kind": "facts", "gen": 192, "tok_s": 24.506362719695712, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 752.9 7834.7 length 118 175 0 52516 141990 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 90.2, "power_w": 98.0, "n": 43}, "1": {"util": 74.8, "power_w": 89.8, "n": 43}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 960.7934655775963, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4285.0 223.6 length 4 8 0 4127 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18009", "tok_s": null, "gpu": {"0": {"util": 28.5, "power_w": 98.3, "n": 22}, "1": {"util": 52.5, "power_w": 93.7, "n": 22}}, "sha": "6b7941777809adb9"}]}
+{"round": 0, "arm": "pw1", "slots": "2246", "notes": ["strata generate: --pipeline-windows 1: 160 MiB of CUDA0 kept out of the expert cache (the second verifier)", "strata serve: --pipeline-windows 1: two verifiers per stage, 2 stages overlap across windows"], "rows": [{"kind": "story", "gen": 192, "tok_s": 22.482435597189696, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 175.2 8540.0 length 98 176 26 43524 130080 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 58.8, "power_w": 78.6, "n": 44}, "1": {"util": 40.3, "power_w": 88.7, "n": 44}}}, {"kind": "code", "gen": 192, "tok_s": 34.21118278037134, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 19846, 25, 198, 12, 357, 90651, 52589, 1103, 30941, 279, 1906, 314, 10121, 318, 3444, 3110, 506, 1901, 11, 198, 220, 3140, 3110, 506, 9495, 553, 198, 12, 357, 10675, 13640, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 615, 363, 321, 2113, 363, 2107, 1542, 303, 496, 7, 16, 8, 854, 13, 198, 12237, 1358, 1005, 5829, 25, 198, 262, 4071, 198, 262, 357, 2357, 303, 279], "info": "DONE 192 36 694.1 5612.2 length 114 179 0 74063 123840 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "8c648fe23bd96182", "gpu": {"0": {"util": 69.0, "power_w": 87.6, "n": 31}, "1": {"util": 36.9, "power_w": 83.4, "n": 31}}}, {"kind": "facts", "gen": 192, "tok_s": 27.821248478525476, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 780.4 6901.2 length 126 167 0 40786 111840 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 57.8, "power_w": 82.7, "n": 38}, "1": {"util": 33.5, "power_w": 87.4, "n": 38}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 955.3534134682324, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4309.4 238.5 length 4 8 0 3937 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18492", "tok_s": null, "gpu": {"0": {"util": 56.8, "power_w": 92.7, "n": 23}, "1": {"util": 38.5, "power_w": 90.8, "n": 23}}, "sha": "6b7941777809adb9"}]}
+{"round": 0, "arm": "default2", "slots": "2246", "notes": [], "rows": [{"kind": "story", "gen": 192, "tok_s": 22.161943787153, "ids": [760, 29262, 506, 27680, 11144, 3775, 1467, 524, 6299, 303, 26, 424, 55807, 11, 8545, 321, 8229, 499, 1060, 11, 1040, 264, 37260, 36781, 12854, 9990, 888, 279, 1814, 13, 1690, 82697, 645, 16413, 11, 279, 324, 55965, 51624, 11, 279, 29262, 557, 524, 449, 8902, 694, 264, 21070, 13, 1049, 557, 279, 1132, 3065, 421, 17515, 279, 20513, 314, 780, 2199, 13, 271, 36, 69388, 995, 47158, 279, 3000, 364, 25292, 36165, 1578, 13, 1216, 557, 264, 855, 46560, 494, 279, 1788, 36055, 430, 279, 41586, 2835, 5028, 864, 279, 324, 55965, 14217, 2218, 14764, 290, 11, 40642, 291, 11, 321, 13375, 23772, 539, 279, 48331, 13, 5133, 2756, 998, 264, 27163, 20569, 10458, 314, 13017, 25, 81550, 279, 57634, 7881, 17796, 2980, 424, 28056, 3486, 1040, 264, 16508, 6561, 11, 79062, 279, 288, 839, 11, 51924, 279, 8598, 1715, 16456, 11, 321, 8132, 279, 8831, 303, 264, 17032, 48184, 8064, 421, 82738, 314, 11679, 321, 2235, 5392, 13, 1216, 11938, 310, 874, 799, 11, 3462, 364, 279, 7892, 14882, 23167, 852, 3571, 2957, 264, 2182, 11, 321, 1442, 1179, 11, 836, 20319, 998, 6973, 310, 279, 9013, 314, 60889, 11228], "info": "DONE 192 33 191.7 8663.5 length 98 175 26 43352 129600 0 0 0.0 7 0 chunk=0 experts_streamed=0", "sha": "04d168a4cdbc9448", "gpu": {"0": {"util": 58.6, "power_w": 77.0, "n": 45}, "1": {"util": 39.7, "power_w": 85.7, "n": 45}}}, {"kind": "code", "gen": 192, "tok_s": 33.87498015137882, "ids": [2, 436, 34810, 18887, 29806, 303, 12654, 271, 550, 33655, 271, 2014, 2972, 19504, 52, 318, 78994, 39642, 11851, 8, 18887, 332, 3514, 29015, 279, 3140, 5742, 23975, 1455, 948, 424, 23716, 8390, 13, 1165, 3172, 4072, 424, 1608, 264, 10286, 314, 264, 2972, 67, 5309, 391, 52589, 1103, 332, 318, 1891, 496, 7, 16, 8, 2528, 14, 4069, 289, 1906, 14419, 8, 321, 264, 2972, 8038, 2336, 332, 318, 1891, 496, 7, 16, 8, 1328, 18054, 553, 271, 4277, 271, 550, 8363, 29806, 271, 71093, 12305, 198, 12237, 198, 19504, 52, 18887, 29806, 271, 2014, 436, 34810, 318, 78994, 39642, 11851, 8, 6297, 3514, 29015, 279, 3140, 5742, 1429, 1455, 198, 9033, 424, 23716, 1141, 6966, 8390, 13, 271, 1008, 27662, 25, 198, 12, 6328, 4866, 318, 8217, 1590, 26521, 6679, 310, 7552, 364, 496, 7, 16, 8, 18054, 13, 198, 12, 53019, 391, 12, 21390, 1697, 25, 41468, 1674, 2528, 1906, 13, 10877, 283, 1379, 5742, 1429, 11, 198, 220, 34885, 283, 3140, 5742, 1429, 13, 271, 33957, 25, 198, 12, 615, 4702, 1590, 5019, 869, 413, 1328, 6513, 11, 10480, 2357, 310, 1901, 13, 496, 7, 16, 553, 198], "info": "DONE 192 36 818.1 5667.9 length 116 178 0 73981 123360 0 0 0.0 36 0 chunk=0 experts_streamed=0", "sha": "62d390ae86cf9cb7", "gpu": {"0": {"util": 64.7, "power_w": 85.3, "n": 32}, "1": {"util": 30.9, "power_w": 75.9, "n": 32}}}, {"kind": "facts", "gen": 192, "tok_s": 27.68365654963593, "ids": [16, 13, 42120, 369, 279, 23856, 11247, 303, 279, 12570, 1785, 440, 264, 22315, 314, 220, 19, 11, 23, 22, 24, 12754, 13, 198, 17, 13, 42120, 682, 874, 16078, 321, 11120, 9039, 54891, 494, 471, 16, 22, 18, 29922, 310, 220, 19, 17, 22, 29922, 13, 198, 18, 13, 47334, 369, 279, 36056, 11247, 440, 449, 5289, 7099, 9039, 314, 220, 19, 21, 19, 29922, 13, 198, 19, 13, 47334, 85993, 303, 279, 13600, 4944, 310, 1379, 975, 31784, 11, 264, 24057, 3750, 430, 16279, 6721, 12331, 13, 198, 20, 13, 8964, 369, 279, 1132, 3750, 11247, 310, 1761, 2199, 321, 682, 799, 5629, 22486, 11, 279, 16820, 13, 198, 21, 13, 8964, 579, 7099, 369, 12805, 220, 22, 16, 4, 2919, 321, 220, 17, 24, 4, 4128, 13, 198, 22, 13, 20403, 369, 3750, 430, 279, 3605, 27893, 4016, 310, 10679, 48395, 318, 34602, 8, 383, 1141, 7099, 13, 198, 23, 13, 20403, 682, 279, 78802, 63004, 303, 279, 12570, 1785, 11, 93448, 47837, 11, 10932, 220, 17, 16, 13, 24, 12754, 1496, 13, 198, 24, 13, 48017, 369, 279, 7526, 11247, 440, 264, 22315, 314, 220, 16, 18, 24], "info": "DONE 192 37 910.9 6935.5 length 126 162 0 40104 109440 0 0 0.0 37 0 chunk=0 experts_streamed=0", "sha": "1c041145365b71b1", "gpu": {"0": {"util": 60.6, "power_w": 81.1, "n": 39}, "1": {"util": 35.5, "power_w": 80.7, "n": 39}}}, {"kind": "pp4k", "pp_tokens": 4117, "pp_tok_s": 955.5529766740165, "ids": [5836, 76159, 660, 6343, 501, 2909, 321, 47354], "info": "DONE 8 4117 4308.5 240.3 length 4 8 0 3950 5760 0 0 0.0 4117 0 chunk=4110 experts_streamed=18406", "tok_s": null, "gpu": {"0": {"util": 57.8, "power_w": 92.8, "n": 23}, "1": {"util": 43.0, "power_w": 89.5, "n": 23}}, "sha": "6b7941777809adb9"}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2b-exact/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2b-exact/summary.txt
new file mode 100644
index 000000000..ec47a8e12
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p2b-exact/summary.txt
@@ -0,0 +1,45 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | story:tok_s | 22.56 | 1.000 | 0/1 | 1
+pw2s0 | story:tok_s | 19.06 | 0.845 | 0/1 | 1
+pw1 | story:tok_s | 22.48 | 0.996 | 0/1 | 1
+default2 | story:tok_s | 22.16 | 0.982 | 0/1 | 1
+default | code:tok_s | 34.46 | 1.000 | 0/1 | 1
+pw2s0 | code:tok_s | 32.51 | 0.943 | 0/1 | 1
+pw1 | code:tok_s | 34.21 | 0.993 | 0/1 | 1
+default2 | code:tok_s | 33.87 | 0.983 | 0/1 | 1
+default | facts:tok_s | 28.41 | 1.000 | 0/1 | 1
+pw2s0 | facts:tok_s | 24.51 | 0.863 | 0/1 | 1
+pw1 | facts:tok_s | 27.82 | 0.979 | 0/1 | 1
+default2 | facts:tok_s | 27.68 | 0.975 | 0/1 | 1
+default | pp4k:pp_tok_s | 948.27 | 1.000 | 0/1 | 1
+pw2s0 | pp4k:pp_tok_s | 960.79 | 1.013 | 1/1 | 1
+pw1 | pp4k:pp_tok_s | 955.35 | 1.007 | 1/1 | 1
+default2 | pp4k:pp_tok_s | 955.55 | 1.008 | 1/1 | 1
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | story | gpu0 61, gpu1 39 | 80, 90 | 50
+default | code | gpu0 63, gpu1 27 | 88, 81 | 55
+default | facts | gpu0 63, gpu1 39 | 84, 85 | 49
+default | pp4k | gpu0 33, gpu1 45 | 89, 78 | 61
+pw2s0 | story | gpu0 87, gpu1 50 | 97, 83 | 32
+pw2s0 | code | gpu0 94, gpu1 63 | 106, 94 | 22
+pw2s0 | facts | gpu0 90, gpu1 75 | 98, 90 | 18
+pw2s0 | pp4k | gpu0 28, gpu1 52 | 98, 94 | 60
+pw1 | story | gpu0 59, gpu1 40 | 79, 89 | 50
+pw1 | code | gpu0 69, gpu1 37 | 88, 83 | 47
+pw1 | facts | gpu0 58, gpu1 34 | 83, 87 | 54
+pw1 | pp4k | gpu0 57, gpu1 38 | 93, 91 | 52
+default2 | story | gpu0 59, gpu1 40 | 77, 86 | 51
+default2 | code | gpu0 65, gpu1 31 | 85, 76 | 52
+default2 | facts | gpu0 61, gpu1 36 | 81, 81 | 52
+default2 | pp4k | gpu0 58, gpu1 43 | 93, 90 | 50
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+story: 2 distinct -> 04d168a4cdbc9448:default,default2,pw1; 299740b746d9ce42:pw2s0
+code: 3 distinct -> 62d390ae86cf9cb7:default,default2; 871f23cd8466886b:pw2s0; 8c648fe23bd96182:pw1
+facts: 1 distinct
+pp4k: 1 distinct
+default: expert-cache slots ['2246']
+pw2s0: expert-cache slots ['2282']
+pw1: expert-cache slots ['2246']
+default2: expert-cache slots ['2246']
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3-batch/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3-batch/results.jsonl
new file mode 100644
index 000000000..47aadb6c2
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3-batch/results.jsonl
@@ -0,0 +1,15 @@
+{"round": 0, "arm": "default", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 78.23786186235705, "steady": 87.42478751041656, "gpu": {"0": {"util": 47.0, "power_w": 107.2, "n": 45}, "1": {"util": 52.1, "power_w": 110.4, "n": 45}}, "sha": "f9509e296a80d736", "ttft": 0.16458940505981445, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.225228309631348, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 77.6715717212175, "steady": 88.89864232583413, "gpu": {"0": {"util": 45.7, "power_w": 107.6, "n": 45}, "1": {"util": 50.4, "power_w": 111.0, "n": 45}}, "sha": "ce65eead50472c3c", "ttft": 0.21722769737243652, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.299778699874878, "pass": 1}]}
+{"round": 0, "arm": "bg2", "slots": "5924", "notes": [], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 64.1247323695471, "steady": 73.94695888847721, "gpu": {"0": {"util": 90.4, "power_w": 122.8, "n": 54}, "1": {"util": 90.9, "power_w": 128.9, "n": 54}}, "sha": "66445d8a8a2d9dc8", "ttft": 0.27700603008270264, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 25881, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 364, 37685]], "secs": 12.475685596466064, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 69.91008562823073, "steady": 81.03630333279665, "gpu": {"0": {"util": 95.5, "power_w": 129.5, "n": 49}, "1": {"util": 97.0, "power_w": 131.0, "n": 49}}, "sha": "c9642d43b526aab4", "ttft": 0.267559289932251, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 264, 2357, 7225, 264, 12977, 5746, 11, 864, 369, 6103, 13, 1368, 264, 4757, 369, 15740, 318, 33431, 5684, 681, 488, 1144, 1599, 12977, 24836, 13, 271, 332, 33, 2308, 7610, 11290, 411, 539, 1602, 328, 8877, 1, 4598, 1056, 328, 83, 528, 1149, 332, 198, 12, 8618, 2357, 628, 3222, 2972, 33431, 6679, 332, 318, 1856, 1066, 799, 553, 198], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 5081, 4625, 21767, 318, 5182, 51018, 8, 364, 25804, 6302, 321, 40278, 46446, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 37972, 694, 369, 524, 2590, 45305, 13, 271, 794, 2972, 5579, 1271, 332, 198, 12, 2972, 7188, 92217, 21755, 1489, 7318, 321, 24656, 1375, 898, 1982, 1083, 264, 2972, 14892, 220, 16], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 11.443270206451416, "pass": 1}]}
+{"round": 0, "arm": "default2", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 77.61458661720529, "steady": 86.56704607597752, "gpu": {"0": {"util": 44.7, "power_w": 106.1, "n": 46}, "1": {"util": 48.0, "power_w": 109.5, "n": 46}}, "sha": "f9509e296a80d736", "ttft": 0.16382145881652832, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.307340860366821, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 77.89823001453475, "steady": 89.05252418944335, "gpu": {"0": {"util": 49.6, "power_w": 108.9, "n": 44}, "1": {"util": 56.1, "power_w": 112.9, "n": 44}}, "sha": "ce65eead50472c3c", "ttft": 0.2137678861618042, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.26980972290039, "pass": 1}]}
+{"round": 1, "arm": "bg2", "slots": "5924", "notes": [], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 52.34159318089887, "steady": 58.71476513157293, "gpu": {"0": {"util": 95.3, "power_w": 112.9, "n": 67}, "1": {"util": 92.6, "power_w": 122.5, "n": 67}}, "sha": "7ec7067b58152abb", "ttft": 0.2892639636993408, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 264, 1103, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 695, 220, 471, 25804, 55112, 25, 220, 16, 10320, 51, 318, 26605, 25900, 3984, 553, 198, 220, 471, 40278, 55112, 25, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 43792, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 695, 220, 471, 2972, 11993, 8404, 88383, 79118, 332, 2261, 55112], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 15.284211874008179, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 54.56539589234894, "steady": 62.144864079748636, "gpu": {"0": {"util": 98.7, "power_w": 119.2, "n": 64}, "1": {"util": 97.2, "power_w": 127.8, "n": 64}}, "sha": "37587ab3cbfff7e7", "ttft": 0.35900259017944336, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 198, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 653, 38754, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279, 1428, 9581], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 5081, 4625, 21767, 318, 5182, 51018, 8, 364, 25804, 6302, 321, 40278, 46446, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 37972, 694, 369, 524, 2590, 45305, 13, 271, 794, 2972, 5579, 1271, 332, 198, 12, 2972, 7188, 92217, 21755, 1489, 7318, 321, 24656, 1375, 898, 1982, 1083, 264, 2972, 14892, 220, 16], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675]], "secs": 14.661306619644165, "pass": 1}]}
+{"round": 1, "arm": "default2", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 69.28596624565154, "steady": 76.58697484330065, "gpu": {"0": {"util": 49.5, "power_w": 103.8, "n": 52}, "1": {"util": 49.1, "power_w": 107.3, "n": 52}}, "sha": "f9509e296a80d736", "ttft": 0.1701037883758545, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 11.54634976387024, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 70.09272972865872, "steady": 79.53470412095362, "gpu": {"0": {"util": 45.9, "power_w": 106.4, "n": 50}, "1": {"util": 53.4, "power_w": 112.6, "n": 50}}, "sha": "ce65eead50472c3c", "ttft": 0.231878399848938, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 11.413451910018921, "pass": 1}]}
+{"round": 1, "arm": "default", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 72.47273020227696, "steady": 80.15868879502784, "gpu": {"0": {"util": 49.3, "power_w": 103.5, "n": 49}, "1": {"util": 49.8, "power_w": 108.0, "n": 49}}, "sha": "f9509e296a80d736", "ttft": 0.1636873483657837, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 11.038634777069092, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 68.6034084623057, "steady": 77.97098034849014, "gpu": {"0": {"util": 45.7, "power_w": 104.3, "n": 50}, "1": {"util": 50.7, "power_w": 111.5, "n": 50}}, "sha": "ce65eead50472c3c", "ttft": 0.2404496669769287, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 11.66122817993164, "pass": 1}]}
+{"round": 2, "arm": "default2", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 75.51932937070144, "steady": 83.95742468143942, "gpu": {"0": {"util": 46.1, "power_w": 104.9, "n": 47}, "1": {"util": 48.5, "power_w": 108.2, "n": 47}}, "sha": "f9509e296a80d736", "ttft": 0.16376900672912598, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.593314409255981, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 77.49186044559347, "steady": 88.60028351019787, "gpu": {"0": {"util": 47.6, "power_w": 106.5, "n": 45}, "1": {"util": 52.2, "power_w": 112.7, "n": 45}}, "sha": "ce65eead50472c3c", "ttft": 0.21355962753295898, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.323664903640747, "pass": 1}]}
+{"round": 2, "arm": "default", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 69.89625245799733, "steady": 77.04937575359158, "gpu": {"0": {"util": 49.7, "power_w": 103.6, "n": 51}, "1": {"util": 48.1, "power_w": 107.7, "n": 51}}, "sha": "f9509e296a80d736", "ttft": 0.16500592231750488, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 11.445534944534302, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 75.13558838856838, "steady": 86.2454004407456, "gpu": {"0": {"util": 45.0, "power_w": 107.2, "n": 46}, "1": {"util": 53.5, "power_w": 112.7, "n": 46}}, "sha": "ce65eead50472c3c", "ttft": 0.2326894998550415, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.647417783737183, "pass": 1}]}
+{"round": 2, "arm": "bg2", "slots": "5924", "notes": [], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 62.28892921633947, "steady": 71.28661996328252, "gpu": {"0": {"util": 88.4, "power_w": 121.0, "n": 55}, "1": {"util": 88.6, "power_w": 127.6, "n": 55}}, "sha": "7ec7067b58152abb", "ttft": 0.2817244529724121, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 264, 1103, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 695, 220, 471, 25804, 55112, 25, 220, 16, 10320, 51, 318, 26605, 25900, 3984, 553, 198, 220, 471, 40278, 55112, 25, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 43792, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 695, 220, 471, 2972, 11993, 8404, 88383, 79118, 332, 2261, 55112], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 12.843373775482178, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 69.1666008073222, "steady": 80.08932809891947, "gpu": {"0": {"util": 97.4, "power_w": 129.1, "n": 49}, "1": {"util": 96.6, "power_w": 132.2, "n": 49}}, "sha": "37587ab3cbfff7e7", "ttft": 0.2701101303100586, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 198, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 653, 38754, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279, 1428, 9581], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 5081, 4625, 21767, 318, 5182, 51018, 8, 364, 25804, 6302, 321, 40278, 46446, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 37972, 694, 369, 524, 2590, 45305, 13, 271, 794, 2972, 5579, 1271, 332, 198, 12, 2972, 7188, 92217, 21755, 1489, 7318, 321, 24656, 1375, 898, 1982, 1083, 264, 2972, 14892, 220, 16], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675]], "secs": 11.56627607345581, "pass": 1}]}
+{"round": 3, "arm": "default", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 78.09486726149795, "steady": 87.81186387913547, "gpu": {"0": {"util": 45.8, "power_w": 106.5, "n": 45}, "1": {"util": 47.4, "power_w": 110.5, "n": 45}}, "sha": "b6530189bf624d76", "ttft": 0.16706299781799316, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 628, 3512, 1546, 5365, 11, 21998, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353, 17011, 8311, 303, 9714, 318, 68, 1257, 2487, 220, 19, 28885, 466, 220, 23, 28885], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.243951082229614, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 78.307553636448, "steady": 89.53466807310082, "gpu": {"0": {"util": 45.6, "power_w": 108.6, "n": 44}, "1": {"util": 52.6, "power_w": 113.9, "n": 44}}, "sha": "eeaef1ea68605966", "ttft": 0.21252715587615967, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 695, 220, 471, 25804, 55112, 25, 220, 16, 10320, 51, 318, 26605, 25900, 3984, 553, 198, 220, 471, 40278, 55112, 25, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 220, 17, 4006, 18, 10320, 51018, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 695, 220, 471, 2972, 11993, 8404, 88383, 79118, 332, 2261, 55112, 413, 40278], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.21612811088562, "pass": 1}]}
+{"round": 3, "arm": "bg2", "slots": "5924", "notes": [], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 63.198580741711325, "steady": 72.36212159164792, "gpu": {"0": {"util": 87.3, "power_w": 121.7, "n": 55}, "1": {"util": 90.1, "power_w": 127.8, "n": 55}}, "sha": "7ec7067b58152abb", "ttft": 0.2767065763473511, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 264, 1103, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 695, 220, 471, 25804, 55112, 25, 220, 16, 10320, 51, 318, 26605, 25900, 3984, 553, 198, 220, 471, 40278, 55112, 25, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 43792, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 695, 220, 471, 2972, 11993, 8404, 88383, 79118, 332, 2261, 55112], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 12.658512115478516, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 69.21621678320857, "steady": 80.14292765886321, "gpu": {"0": {"util": 96.4, "power_w": 128.4, "n": 49}, "1": {"util": 95.6, "power_w": 131.6, "n": 49}}, "sha": "37587ab3cbfff7e7", "ttft": 0.272688627243042, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 198, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 653, 38754, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279, 1428, 9581], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 5081, 4625, 21767, 318, 5182, 51018, 8, 364, 25804, 6302, 321, 40278, 46446, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 37972, 694, 369, 524, 2590, 45305, 13, 271, 794, 2972, 5579, 1271, 332, 198, 12, 2972, 7188, 92217, 21755, 1489, 7318, 321, 24656, 1375, 898, 1982, 1083, 264, 2972, 14892, 220, 16], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675]], "secs": 11.557985067367554, "pass": 1}]}
+{"round": 3, "arm": "default2", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 78.54759836798948, "steady": 87.76762661780747, "gpu": {"0": {"util": 48.0, "power_w": 106.8, "n": 45}, "1": {"util": 50.2, "power_w": 109.2, "n": 45}}, "sha": "f9509e296a80d736", "ttft": 0.16370105743408203, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.18490719795227, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 77.54832130291335, "steady": 88.60845765615011, "gpu": {"0": {"util": 43.4, "power_w": 108.4, "n": 44}, "1": {"util": 53.7, "power_w": 114.4, "n": 44}}, "sha": "ce65eead50472c3c", "ttft": 0.21450114250183105, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.316148519515991, "pass": 1}]}
+{"round": 4, "arm": "bg2", "slots": "5924", "notes": [], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 62.871807171123635, "steady": 72.0523494982184, "gpu": {"0": {"util": 90.0, "power_w": 121.6, "n": 55}, "1": {"util": 91.5, "power_w": 128.8, "n": 55}}, "sha": "7ec7067b58152abb", "ttft": 0.2790151834487915, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 264, 1103, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 695, 220, 471, 25804, 55112, 25, 220, 16, 10320, 51, 318, 26605, 25900, 3984, 553, 198, 220, 471, 40278, 55112, 25, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 43792, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 695, 220, 471, 2972, 11993, 8404, 88383, 79118, 332, 2261, 55112], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 12.72430419921875, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 69.15261276513098, "steady": 80.06090732627624, "gpu": {"0": {"util": 97.0, "power_w": 128.3, "n": 50}, "1": {"util": 95.2, "power_w": 131.1, "n": 50}}, "sha": "37587ab3cbfff7e7", "ttft": 0.2703859806060791, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 2521, 52351, 310, 56014, 813, 62, 17, 443, 12576, 4213, 11, 303, 12977, 5792, 5757, 11, 30745, 795, 17077, 2972, 40, 17011, 7289, 93868, 864, 513, 6103, 13, 357, 42102, 440, 2521, 220, 17, 15, 7225, 685, 310, 220, 17, 15, 12977, 24836, 13, 271, 32, 2972, 33, 39100, 332, 24469, 279, 2521, 314, 279, 4757, 539, 10377, 1754, 2357, 310, 599, 2972, 33431, 2748, 332, 318, 11553, 82515, 7911, 553, 1061, 20537, 4603, 279, 1324, 314, 12977], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 198, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 653, 38754, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279, 1428, 9581], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 5081, 4625, 21767, 318, 5182, 51018, 8, 364, 25804, 6302, 321, 40278, 46446, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 37972, 694, 369, 524, 2590, 45305, 13, 271, 794, 2972, 5579, 1271, 332, 198, 12, 2972, 7188, 92217, 21755, 1489, 7318, 321, 24656, 1375, 898, 1982, 1083, 264, 2972, 14892, 220, 16], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675]], "secs": 11.568615674972534, "pass": 1}]}
+{"round": 4, "arm": "default2", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 78.093604059307, "steady": 87.25921185724515, "gpu": {"0": {"util": 48.8, "power_w": 107.1, "n": 46}, "1": {"util": 48.8, "power_w": 110.7, "n": 46}}, "sha": "f9509e296a80d736", "ttft": 0.16201460361480713, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 303, 4475, 5757, 321, 999, 5757, 1521, 424, 369, 32237, 364, 12977, 5638, 13, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 303, 4779, 11, 781, 513, 61240, 364, 12977, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 74992, 13, 198, 17, 13, 220, 2972, 45998, 353, 17011, 35032, 57018, 64700, 37582, 2528, 369, 6103, 13, 8618, 2357, 2528, 7225, 264, 12977, 1301, 13, 357, 5365, 4757], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 198, 220, 471, 2972, 11993, 8404, 88383, 79118, 92217, 1368, 264, 9849, 369, 5384, 2261, 55112, 11, 311, 1405, 2641, 30056, 279, 4307, 3511, 13, 198, 220, 471, 2972, 42480, 1944, 5487, 2133, 92217, 6438, 83317, 19674, 802], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.24411678314209, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 77.18008388447508, "steady": 88.20632767433932, "gpu": {"0": {"util": 47.6, "power_w": 106.2, "n": 45}, "1": {"util": 54.2, "power_w": 112.9, "n": 45}}, "sha": "ce65eead50472c3c", "ttft": 0.21382486820220947, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.365368366241455, "pass": 1}]}
+{"round": 4, "arm": "default", "slots": "5924", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 800, "tok_s": 78.14651358059413, "steady": 87.37507513966035, "gpu": {"0": {"util": 48.1, "power_w": 105.9, "n": 45}, "1": {"util": 51.2, "power_w": 109.4, "n": 45}}, "sha": "b6530189bf624d76", "ttft": 0.16410315036773682, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 628, 3512, 1546, 5365, 11, 21998, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353, 17011, 8311, 303, 9714, 318, 68, 1257, 2487, 220, 19, 28885, 466, 220, 23, 28885], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494, 40278, 55112, 13, 198, 220, 471, 2972, 48218, 8274, 28692, 92217, 220, 16, 10320, 51, 318, 26605, 9009, 4412, 3984, 553, 198, 220, 471, 2972, 43922, 8274, 28692, 92217, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 2972, 17, 4006, 18, 10320, 51018, 332, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 22418, 2179, 92217, 4962, 2763, 37972, 4016, 310, 49282, 1375, 898, 1982, 13, 198, 12, 2972, 1026, 58532, 92217, 40278, 3669, 577, 58532, 318, 19492, 3669, 27437, 466, 13990, 8, 628, 7698, 16905, 1375, 898, 1982, 310, 220, 16, 10320], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 318, 66, 13, 220, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 318, 66, 13, 220, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90]], "secs": 10.237180948257446, "pass": 0}, {"kind": "batch", "tokens": 800, "tok_s": 78.27163050555652, "steady": 89.61071899380703, "gpu": {"0": {"util": 48.1, "power_w": 107.9, "n": 44}, "1": {"util": 54.5, "power_w": 112.2, "n": 44}}, "sha": "eeaef1ea68605966", "ttft": 0.21281588077545166, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13, 271, 4277, 271, 13962, 220, 16, 13, 9237, 33214, 25, 8169, 417, 2308, 7610, 30, 271, 81760, 7620, 2624, 12052, 318, 58950, 82, 8, 599, 264, 82515, 7911, 314, 220, 17, 318, 9264, 2357, 682, 506, 1379, 220, 17, 2748, 553, 5788, 10727, 364, 303, 61932, 795, 11, 781, 513, 61240, 364, 12977, 5792, 5638, 1521, 25, 198, 16, 13, 220, 2972, 11635, 42467, 64700, 357, 42102, 440, 393, 45, 3, 5255, 682, 264, 2521, 314, 56014, 813, 62, 17, 443, 12576, 1690, 3349, 28465, 11, 411, 3254, 1599, 12977, 24836, 13, 198, 17, 13, 220, 2972, 81203, 37582, 9865, 1954, 64700, 37582, 353], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299, 4702, 26612, 830, 25, 830, 58, 15, 2387, 271, 262, 25170, 283, 498, 390, 40798, 58, 15, 4891, 271, 262, 364, 1428, 303, 26126, 58, 16, 25, 5491, 198, 285, 1483, 283, 25170, 7368, 16, 60, 271, 285, 653, 1368, 279, 1428, 9581, 73406, 440, 279, 1483, 25170, 9581, 11, 198, 285, 653, 10562, 1070, 539, 31291, 279, 809, 314, 279, 1483, 9581, 13, 198, 285, 413, 1428, 58, 15, 60, 2564, 1483, 58, 16, 5491, 198, 309, 1483, 58, 16, 60, 283, 1866, 22634, 58, 16, 1089, 1428, 58, 16, 2387, 198, 285, 745, 25, 198, 309, 653, 2233, 26370, 11, 884, 279], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118, 11, 1179, 40278, 318, 26666, 22028, 7977, 8, 25822, 264, 8387, 55112, 318, 58768, 21998, 4945, 4625, 21767, 553, 1061, 369, 3750, 430, 2972, 48218, 478, 40278, 159034, 198, 12, 2972, 22418, 2179, 92217, 695, 220, 471, 25804, 55112, 25, 220, 16, 10320, 51, 318, 26605, 25900, 3984, 553, 198, 220, 471, 40278, 55112, 25, 22484, 220, 16, 4006, 17, 10320, 51018, 318, 77704, 383, 40278, 2243, 553, 198, 220, 471, 2972, 7354, 92217, 220, 17, 4006, 18, 10320, 51018, 1518, 795, 628, 381, 3106, 13, 198, 12, 2972, 82864, 92217, 695, 220, 471, 2972, 11993, 8404, 88383, 79118, 332, 2261, 55112, 413, 40278], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 9923, 9214, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33, 365, 25173, 5212, 29752, 16, 24, 15, 15, 75887, 188912, 11851, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 17, 20, 3, 1651, 18, 478, 1088, 35790, 90, 16, 14728, 23, 30675, 553, 198, 12, 2972, 82707, 5212, 29752, 16, 21, 20, 15, 75887, 188912, 561, 17432, 474, 387, 86125, 1429, 56014, 2413, 1088, 46451, 220, 18, 13, 16, 21, 15, 20, 3, 1651, 59, 35790, 90, 17, 20, 21, 14728, 23, 16, 30675, 553, 198, 12, 2972, 18164, 316, 56548, 515, 4807, 26048, 1052, 64700, 8727, 1429, 56014, 2413, 1088, 46451, 220, 18, 3, 466, 56014, 35790, 90, 17, 17, 14728, 22, 30675, 318]], "secs": 10.220816850662231, "pass": 1}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3-batch/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3-batch/summary.txt
new file mode 100644
index 000000000..431c64c2b
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3-batch/summary.txt
@@ -0,0 +1,21 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | batch:tok_s | 77.95 | 1.000 | 0/5 | 5
+bg2 | batch:tok_s | 66.01 | 0.847 | 0/5 | 5
+default2 | batch:tok_s | 77.64 | 0.996 | 1/5 | 5
+default | batch:steady | 88.16 | 1.000 | 0/5 | 5
+bg2 | batch:steady | 76.06 | 0.863 | 0/5 | 5
+default2 | batch:steady | 87.73 | 0.995 | 1/5 | 5
+default | batch:ttft | 0.19 | 1.000 | 0/5 | 5
+bg2 | batch:ttft | 0.27 | 1.439 | 0/5 | 5
+default2 | batch:ttft | 0.19 | 0.989 | 5/5 | 5
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | batch | gpu0 46, gpu1 51 | 107, 111 | 51
+bg2 | batch | gpu0 95, gpu1 94 | 122, 129 | 5
+default2 | batch | gpu0 48, gpu1 51 | 106, 112 | 51
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+batch: 8 distinct -> f9509e296a80d736:default,default2; ce65eead50472c3c:default,default2; 66445d8a8a2d9dc8:bg2; c9642d43b526aab4:bg2; 7ec7067b58152abb:bg2; 37587ab3cbfff7e7:bg2; b6530189bf624d76:default; eeaef1ea68605966:default
+default: expert-cache slots ['5924']
+bg2: expert-cache slots ['5924']
+default2: expert-cache slots ['5924']
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3x-batchexact/results.jsonl b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3x-batchexact/results.jsonl
new file mode 100644
index 000000000..f8accaa83
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3x-batchexact/results.jsonl
@@ -0,0 +1,3 @@
+{"round": 0, "arm": "default", "slots": "2246", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 384, "tok_s": 28.685621979103832, "steady": 32.33867624131522, "gpu": {"0": {"util": 60.4, "power_w": 79.0, "n": 58}, "1": {"util": 42.3, "power_w": 84.2, "n": 58}}, "sha": "c5c805ed94773556", "ttft": 0.31592702865600586, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33]], "secs": 13.386497259140015, "pass": 0}]}
+{"round": 0, "arm": "bg2", "slots": "2246", "notes": [], "rows": [{"kind": "batch", "tokens": 384, "tok_s": 30.255629228893316, "steady": 37.38017699866811, "gpu": {"0": {"util": 92.0, "power_w": 91.4, "n": 50}, "1": {"util": 85.3, "power_w": 100.4, "n": 50}}, "sha": "8f596d32d5c6c1ae", "ttft": 0.4895660877227783, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 15787, 314, 1379, 6278, 4475, 5757, 318, 4650, 25498, 11, 71100, 11, 321, 27413, 8, 321, 999, 5757, 318, 4650, 17132, 8225, 321, 1258, 19, 553, 271, 41657, 264, 17190, 7304, 8672, 318, 58950, 681, 1332, 1754, 2357, 682, 506, 1379, 1330, 2748, 11, 264, 417, 39100, 369, 264, 2972, 25429, 25941, 2624, 4757, 159034, 8618, 2357, 628], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 61416, 264, 3511, 1118], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33]], "secs": 12.691853046417236, "pass": 0}]}
+{"round": 0, "arm": "default2", "slots": "2246", "notes": ["strata generate: --batch-groups auto: 1 group of 4 slots - serial windows (measured faster than pipelined groups on two NVIDIA cards; STRATA_BATCH_GROUPS_NV_SERIAL=0 keeps the pipeline); --batch-groups 2 asks for the pipelined groups"], "rows": [{"kind": "batch", "tokens": 384, "tok_s": 28.839485538158076, "steady": 32.50552225346136, "gpu": {"0": {"util": 61.9, "power_w": 79.6, "n": 58}, "1": {"util": 37.8, "power_w": 84.5, "n": 58}}, "sha": "c5c805ed94773556", "ttft": 0.3142596483230591, "ids": [[32, 2972, 33, 39100, 332, 369, 264, 638, 80255, 8703, 4757, 795, 5759, 421, 30941, 10300, 795, 321, 5954, 25628, 11, 49282, 2528, 11, 5479, 880, 11, 321, 18686, 880, 303, 86844, 20569, 854, 13, 1049, 369, 279, 1379, 4047, 795, 5759, 1429, 310, 4072, 4475, 24163, 321, 999, 5757, 1521, 424, 369, 32237, 364, 5757, 421, 1301, 321, 3165, 3349, 9714, 314, 795, 318, 4650, 12977, 19505, 553, 271, 36948, 369, 264, 11346, 15673, 314, 1204, 264, 417, 39100, 4138, 11, 17661, 1141, 5759, 11, 5706, 11, 7289, 11, 321, 3069, 424, 369, 10727, 13], [71093, 12305, 198, 727, 10562, 87682, 1494, 40798, 25, 1103, 65342, 18078, 28649, 1411, 1103, 65342, 18078, 4891, 25, 198, 262, 4071, 198, 262, 38754, 48142, 26126, 13, 271, 262, 17167, 25, 198, 285, 26126, 25, 357, 1103, 314, 26126, 11, 1332, 1754, 9581, 369, 498, 2388, 11, 809, 906, 271, 262, 5019, 25, 198, 285, 357, 1103, 314, 25170, 11, 2397, 27335, 87502, 26126, 10300, 539, 1151, 854, 13, 198, 262, 4071, 198, 262, 413, 524, 26126, 25, 198, 285, 460, 2958, 271, 262, 653, 15495, 26126, 539, 836, 1151, 854, 198, 262, 26126, 10299], [8160, 369, 264, 11346, 11960, 314, 2972, 48218, 332, 318, 88061, 7533, 23796, 8, 321, 2972, 5579, 1271, 332, 318, 23554, 40986, 7779, 63726, 8, 3808, 279, 2250, 3050, 14890, 25, 2972, 2239, 28692, 93868, 2972, 29431, 41085, 7533, 93868, 321, 2972, 55334, 2486, 286, 159034, 271, 4277, 271, 13962, 220, 16, 13, 8274, 28692, 271, 794, 2972, 48218, 332, 198, 12, 2972, 7188, 92217, 37539, 264, 2972, 18, 25941, 55112, 332, 318, 17867, 45, 11069, 59612, 12, 3897, 11069, 51959, 553, 198, 12, 2972, 43922, 38738, 92217, 14627, 16898, 11, 25804, 55112, 369, 8387, 494], [760, 3712, 314, 36370, 56014, 2413, 3, 318, 2413, 8, 369, 264, 11285, 494, 50717, 54315, 310, 23064, 3878, 11, 321, 5326, 310, 52652, 61934, 5176, 13, 1049, 25133, 279, 14931, 314, 36352, 4924, 84830, 16547, 310, 79817, 310, 6165, 7785, 13, 271, 8160, 369, 279, 83545, 3712, 314, 279, 21261, 314, 56014, 2413, 53031, 494, 9214, 316, 56548, 310, 3242, 13, 271, 4277, 271, 13962, 220, 16, 13, 35725, 42368, 93046, 318, 4551, 6481, 47422, 316, 56548, 8, 198, 9923, 45332, 34780, 74519, 11, 13437, 82517, 1429, 44142, 9556, 93046, 13, 271, 12, 2972, 33]], "secs": 13.315078020095825, "pass": 0}]}
diff --git a/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3x-batchexact/summary.txt b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3x-batchexact/summary.txt
new file mode 100644
index 000000000..a0702a535
--- /dev/null
+++ b/bench/results/2026-10-20-0.2.1-idle-gpu/z440/p3x-batchexact/summary.txt
@@ -0,0 +1,21 @@
+arm | metric | median | vs base | pairs faster (higher) | rounds
+default | batch:tok_s | 28.69 | 1.000 | 0/1 | 1
+bg2 | batch:tok_s | 30.26 | 1.055 | 1/1 | 1
+default2 | batch:tok_s | 28.84 | 1.005 | 1/1 | 1
+default | batch:steady | 32.34 | 1.000 | 0/1 | 1
+bg2 | batch:steady | 37.38 | 1.156 | 1/1 | 1
+default2 | batch:steady | 32.51 | 1.005 | 1/1 | 1
+default | batch:ttft | 0.32 | 1.000 | 0/1 | 1
+bg2 | batch:ttft | 0.49 | 1.550 | 0/1 | 1
+default2 | batch:ttft | 0.31 | 0.995 | 1/1 | 1
+
+arm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)
+default | batch | gpu0 60, gpu1 42 | 79, 84 | 49
+bg2 | batch | gpu0 92, gpu1 85 | 91, 100 | 11
+default2 | batch | gpu0 62, gpu1 38 | 80, 84 | 50
+
+answer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)
+batch: 2 distinct -> c5c805ed94773556:default,default2; 8f596d32d5c6c1ae:bg2
+default: expert-cache slots ['2246']
+bg2: expert-cache slots ['2246']
+default2: expert-cache slots ['2246']
diff --git a/tools/idle_gpu_ab.py b/tools/idle_gpu_ab.py
new file mode 100644
index 000000000..bb9add869
--- /dev/null
+++ b/tools/idle_gpu_ab.py
@@ -0,0 +1,376 @@
+"""2507-0: how idle are the GPUs, and does an existing switch close the gap? Interleaved A/B of whole engine runs
+(fresh engine per arm run, rotating arm order), with a per-card utilisation sampler (nvidia-smi, 5 samples/s) over every
+decode, prompt and batch window. Derived from the 0.2.1 split A/B harness; measurement only, no engine change.
+
+ python split_ab.py single CONFIG OUTDIR --arm name=EXE!ARGS!K=V,K=V ... [--pairs 6] [--new 300] [--warm 2] [--pps 4096,20480] [--extra "..."]
+ per run: WARM x 64-token requests, then story/code/facts greedy requests of --new tokens, then one prompt read per --pps length
+ python split_ab.py batch CONFIG OUTDIR --batch N --arm ... [--pairs 5] [--new 200]
+ per run: engine with --batch N, one warm batch (48 tokens), then --passes batch passes of N prompts (BGEN), aggregate tok/s
+ python split_ab.py --summary OUTDIR [--base name]
+
+Results: OUTDIR/results.jsonl, one line per arm run.
+"""
+import hashlib
+import json
+import os
+import re
+import statistics
+import subprocess
+import sys
+import threading
+import time
+
+
+class Sampler:
+ """nvidia-smi utilisation/power per card, time stamped on arrival; window(t0, t1) -> per-card means."""
+
+ def __init__(self):
+ self.rows = []
+ self.proc = subprocess.Popen(["nvidia-smi", "--query-gpu=index,utilization.gpu,power.draw", "--format=csv,noheader,nounits",
+ "-lms", "200"], stdout=subprocess.PIPE, text=True)
+ threading.Thread(target=self._read, daemon=True).start()
+
+ def _read(self):
+ for line in self.proc.stdout:
+ try:
+ i, u, w = [x.strip() for x in line.split(",")]
+ self.rows.append((time.time(), int(i), float(u), float(w)))
+ except ValueError:
+ pass
+
+ def window(self, t0, t1):
+ out = {}
+ for t, i, u, w in list(self.rows):
+ if t0 <= t <= t1:
+ d = out.setdefault(i, [[], []])
+ d[0].append(u)
+ d[1].append(w)
+ return {str(i): {"util": round(sum(d[0]) / len(d[0]), 1), "power_w": round(sum(d[1]) / len(d[1]), 1), "n": len(d[0])}
+ for i, d in sorted(out.items())}
+
+ def stop(self):
+ self.proc.kill()
+
+
+SMP = None
+from pathlib import Path
+
+
+def args_of(name):
+ return [sys.argv[i + 1] for i, a in enumerate(sys.argv) if a == name]
+
+
+def arg(name, default):
+ return sys.argv[sys.argv.index(name) + 1] if name in sys.argv else default
+
+
+def med(xs):
+ xs = [x for x in xs if x is not None]
+ return statistics.median(xs) if xs else float("nan")
+
+
+def summary(out, base=None):
+ R = [json.loads(l) for l in open(out / "results.jsonl")]
+ names = []
+ for r in R:
+ if r["arm"] not in names:
+ names.append(r["arm"])
+ base = base or names[0]
+ keys = []
+ for r in R:
+ for x in r["rows"]:
+ k = (x["kind"], "tok_s" if x.get("tok_s") is not None else "pp_tok_s")
+ if k not in keys and x["kind"] != "batch":
+ keys.append(k)
+ if any(x["kind"] == "batch" for r in R for x in r["rows"]):
+ keys += [("batch", "tok_s"), ("batch", "steady"), ("batch", "ttft")]
+
+ def per_round(arm, kind, key):
+ d = {}
+ for r in R:
+ if r["arm"] == arm:
+ v = [x.get(key) for x in r["rows"] if x["kind"] == kind]
+ d[r["round"]] = med(v)
+ return d
+
+ print("arm | metric | median | vs base | pairs faster (higher) | rounds")
+ for kind, key in keys:
+ for nm in names:
+ a, b = per_round(base, kind, key), per_round(nm, kind, key)
+ rounds = [i for i in sorted(set(a) & set(b)) if a[i] == a[i] and b[i] == b[i]]
+ if not rounds:
+ continue
+ ma, mb = med([a[i] for i in rounds]), med([b[i] for i in rounds])
+ fb = sum(1 for i in rounds if (b[i] < a[i] if key == "ttft" else b[i] > a[i]))
+ print(f"{nm} | {kind}:{key} | {mb:.2f} | {mb / ma:.3f} | {fb}/{len(rounds)} | {len(rounds)}")
+ print("\narm | window | mean util per card % (median over runs) | mean power W per card | idle% (mean over cards)")
+ kinds = []
+ for r in R:
+ for x in r["rows"]:
+ if x["kind"] not in kinds:
+ kinds.append(x["kind"])
+ for nm in names:
+ for kind in kinds:
+ us, ws = {}, {}
+ for r in R:
+ if r["arm"] != nm:
+ continue
+ for x in r["rows"]:
+ if x["kind"] == kind:
+ for gi, g in (x.get("gpu") or {}).items():
+ us.setdefault(gi, []).append(g["util"])
+ ws.setdefault(gi, []).append(g["power_w"])
+ if us:
+ mu = {gi: med(v) for gi, v in us.items()}
+ print(f"{nm} | {kind} | {', '.join(f'gpu{gi} {v:.0f}' for gi, v in sorted(mu.items()))} | "
+ f"{', '.join(f'{med(v):.0f}' for gi, v in sorted(ws.items()))} | {100 - sum(mu.values()) / len(mu):.0f}")
+ print("\nanswer hashes per window kind (distinct values over all runs of all arms; 1 = byte-identical)")
+ for kind in kinds:
+ hs = {}
+ for r in R:
+ for x in r["rows"]:
+ if x["kind"] == kind and x.get("sha"):
+ hs.setdefault(x["sha"], set()).add(r["arm"])
+ print(f"{kind}: {len(hs)} distinct" + ("" if len(hs) == 1 else " -> " + "; ".join(f"{h}:{','.join(sorted(a))}" for h, a in hs.items())))
+ for nm in names:
+ sl = sorted({r.get("slots") for r in R if r["arm"] == nm}, key=str)
+ print(f"{nm}: expert-cache slots {sl}")
+
+
+if "--summary" in sys.argv:
+ summary(Path(arg("--summary", ".")), arg("--base", None))
+ sys.exit(0)
+
+MODE = sys.argv[1]
+REPO = Path(os.environ["STRATA_REPO"])
+sys.path.insert(0, str(REPO / "tools"))
+sys.path.insert(0, str(REPO))
+import strata_tokenizer as ST # noqa: E402
+from serve.server import child_env # noqa: E402
+
+SMP = Sampler()
+CFG, OUT = sys.argv[2], Path(sys.argv[3])
+PAIRS = int(arg("--pairs", "5"))
+NEW = int(arg("--new", "300" if MODE == "single" else "200"))
+WARM = int(arg("--warm", "2"))
+PPS = [int(x) for x in arg("--pps", "0").split(",") if int(x)]
+BATCH = int(arg("--batch", "2"))
+PASSES = int(arg("--passes", "2"))
+extra = arg("--extra", "").split()
+ARMS = []
+for a in args_of("--arm"):
+ nm, rest = a.split("=", 1)
+ exe, xargs, envs = (rest.split("!") + ["", ""])[:3]
+ ARMS.append((nm, exe, xargs.split(), dict(kv.split("=", 1) for kv in envs.split(",") if kv)))
+OUT.mkdir(parents=True, exist_ok=True)
+cfg = json.load(open(CFG, encoding="utf-8-sig"))
+tp = Path(cfg["tokenizer"])
+vocab = json.loads((tp / "vocab.json").read_text(encoding="utf-8"))
+toks = [None] * len(vocab)
+for t, i in vocab.items():
+ toks[i] = t
+tok = ST.Tokenizer(toks, (tp / "merges.txt").read_text(encoding="utf-8").split("\n"),
+ json.loads((tp / "token_type.json").read_text()))
+HEAD = tok.encode("<|im_start|>user\n", parse_special=True)
+TAIL = tok.encode("<|im_end|>\n<|im_start|>assistant\n<think>\n\n</think>\n\n", parse_special=True)
+KINDS = ["story", "code", "facts"]
+ASK = {
+ "story": "Write a long story about a lighthouse keeper who finds a message in a bottle. Make it detailed.",
+ "code": "Write a Python program that implements an LRU cache class with get and put, plus unit tests. Explain each part.",
+ "facts": "Give me twenty well-known facts about the planets of the solar system, one per line, with the key numbers for each.",
+}
+QUESTIONS = [
+ "Explain in detail how a B-tree works.",
+ "Write a Python function that merges overlapping intervals, then explain it.",
+ "Compare TCP and QUIC: handshake, congestion control, multiplexing.",
+ "Tell the history of the calculation of pi, from Archimedes to today.",
+]
+_DOC = []
+
+
+def doc_ids(n, start=30000):
+ if not _DOC:
+ txt = ""
+ for f in sorted((REPO / "docs").glob("*.md")):
+ txt += f.read_text(encoding="utf-8", errors="replace") + "\n"
+ txt = txt * 8
+ _DOC.extend(tok.encode(txt[start:], parse_special=False))
+ return _DOC[:n]
+
+
+def ids_for(name, n=0):
+ if name == "pp":
+ return HEAD + tok.encode("Summarise:\n\n", parse_special=False) + doc_ids(n, 5000) + tok.encode("\n\nOne line.", parse_special=False) + TAIL
+ if name.startswith("q"):
+ return HEAD + tok.encode(QUESTIONS[int(name[1:])], parse_special=False) + TAIL
+ return HEAD + tok.encode(ASK[name], parse_special=False) + TAIL
+
+
+def clean_env(env_extra):
+ env = child_env(cfg)
+ for k in list(env):
+ if k.startswith("STRATA_"):
+ env.pop(k, None)
+ env["STRATA_DECODE_TIMING"] = "1"
+ env.update(env_extra)
+ return env
+
+
+def finish(p, log):
+ try:
+ p.stdin.close()
+ except Exception:
+ pass
+ try:
+ p.wait(120)
+ except Exception:
+ p.kill()
+ txt = open(log, errors="replace").read()
+ slots = re.findall(r"expert cache (\d+) slots", txt)
+ notes = [l for l in txt.splitlines() if re.search(r"batch_groups|pipeline.windows|SPLIT_OVERLAP|handoff", l, re.I)][:4]
+ return (slots[0] if slots else None), notes
+
+
+def start(exe, args, env, log):
+ lf = open(log, "w")
+ p = subprocess.Popen([exe, "--serve", *args], cwd=cfg.get("cwd"), stdin=subprocess.PIPE, stdout=subprocess.PIPE,
+ stderr=lf, text=True, bufsize=1, env=env)
+ for line in p.stdout:
+ if line.startswith("READY"):
+ return p
+ raise SystemExit(f"engine ended before READY: {log}")
+
+
+def gen(p, ids, n):
+ p.stdin.write(f"GEN {n} {','.join(map(str, ids))}\n")
+ p.stdin.flush()
+ got, info = [], ""
+ for line in p.stdout:
+ line = line.rstrip("\n")
+ if line.startswith("T "):
+ got.append(int(line.split()[1]))
+ elif line.startswith("DONE") or line.startswith("ERR"):
+ info = line
+ break
+ return got, info
+
+
+def kv_of(info):
+ f = info.split()
+ if len(f) < 5 or f[0] != "DONE":
+ return {}
+ return {"generated": f[1], "prompt_tokens": f[2], "prompt_ms": f[3], "decode_ms": f[4]}
+
+
+def run_single(label, exe, xargs, env_extra):
+ log = OUT / f"{label}.log"
+ p = start(exe, list(cfg["args"]) + extra + xargs, clean_env(env_extra), str(log))
+ for i in range(WARM):
+ gen(p, ids_for(KINDS[i % len(KINDS)]), 64)
+ rows = []
+ for name in KINDS:
+ t0 = time.time()
+ out, info = gen(p, ids_for(name), NEW)
+ t1 = time.time()
+ d = kv_of(info)
+ g, dms = d.get("generated"), d.get("decode_ms")
+ rows.append({"kind": name, "gen": len(out), "tok_s": (len(out) / float(dms) * 1000.0) if dms else None, "ids": out, "info": info,
+ "sha": hashlib.sha256(",".join(map(str, out)).encode()).hexdigest()[:16], "gpu": SMP.window(t0, t1)})
+ for n in PPS:
+ ids = ids_for("pp", n)
+ t0 = time.time()
+ out, info = gen(p, ids, 8)
+ t1 = time.time()
+ d = kv_of(info)
+ pms = d.get("prompt_ms")
+ rows.append({"kind": f"pp{n // 1024}k", "pp_tokens": len(ids), "pp_tok_s": (len(ids) / float(pms) * 1000.0) if pms else None,
+ "ids": out, "info": info, "tok_s": None, "gpu": SMP.window(t0, t1),
+ "sha": hashlib.sha256(",".join(map(str, out)).encode()).hexdigest()[:16]})
+ slots, notes = finish(p, log)
+ return rows, slots, notes
+
+
+def batch_pass(p, n_new, n):
+ prompts = [ids_for(f"q{i % len(QUESTIONS)}") for i in range(n)]
+ got = {i: [] for i in range(n)}
+ first = {}
+ sent = {}
+ done = {}
+ stamp = []
+ t0 = time.time()
+ for i, ids in enumerate(prompts):
+ sent[i] = time.time()
+ p.stdin.write(f"BGEN {i} {n_new} {','.join(map(str, ids))}\n")
+ p.stdin.flush()
+ for line in p.stdout:
+ if line.startswith("T "):
+ got[i].append(int(line.split()[1]))
+ first.setdefault(i, time.time())
+ stamp.append(time.time())
+ elif line.startswith("BT "):
+ _, s, y = line.split()
+ got[int(s)].append(int(y))
+ first.setdefault(int(s), time.time())
+ stamp.append(time.time())
+ elif line.startswith("BDONE "):
+ done[int(line.split()[1])] = line
+ elif line.startswith("ERR"):
+ raise SystemExit("batch ERR: " + line)
+ elif line.startswith("BADM "):
+ if line.split()[2] == "0":
+ done[i] = line
+ break
+ t_adm = time.time()
+ while len(done) < n:
+ line = p.stdout.readline()
+ if not line:
+ raise SystemExit("engine ended in batch")
+ if line.startswith("BT "):
+ _, s, y = line.split()
+ got[int(s)].append(int(y))
+ first.setdefault(int(s), time.time())
+ stamp.append(time.time())
+ elif line.startswith("BDONE "):
+ done[int(line.split()[1])] = line
+ elif line.startswith("ERR"):
+ raise SystemExit("batch ERR: " + line)
+ t_end = time.time()
+ total = sum(len(v) for v in got.values())
+ late = sum(1 for s in stamp if s > t_adm)
+ return {"kind": "batch", "tokens": total, "tok_s": total / (t_end - t0), "steady": late / max(t_end - t_adm, 1e-9),
+ "gpu": SMP.window(t_adm, t_end), "sha": hashlib.sha256(json.dumps([got[i] for i in range(n)]).encode()).hexdigest()[:16],
+ "ttft": med([first[i] - sent[i] for i in first]), "ids": [got[i] for i in range(n)], "secs": t_end - t0}
+
+
+def run_batch(label, exe, xargs, env_extra):
+ log = OUT / f"{label}.log"
+ p = start(exe, list(cfg["args"]) + ["--batch", str(BATCH)] + extra + xargs, clean_env(env_extra), str(log))
+ batch_pass(p, 48, BATCH)
+ rows = [batch_pass(p, NEW, BATCH) for _ in range(PASSES)]
+ for r in rows:
+ r["pass"] = rows.index(r)
+ p.stdin.write("QUIT\n")
+ p.stdin.flush()
+ slots, notes = finish(p, log)
+ return rows, slots, notes
+
+
+res = OUT / "results.jsonl"
+ROUND0 = int(arg("--round0", "0"))
+only = arg("--only", None)
+for rnd in range(ROUND0, ROUND0 + (1 if only else PAIRS)):
+ order = ARMS[rnd % len(ARMS):] + ARMS[:rnd % len(ARMS)]
+ for nm, exe, xargs, e in order:
+ if only and nm not in only.split(","):
+ continue
+ fn = run_single if MODE == "single" else run_batch
+ rows, slots, notes = fn(f"{nm}_{rnd}", exe, xargs, e)
+ with open(res, "a") as f:
+ f.write(json.dumps({"round": rnd, "arm": nm, "slots": slots, "notes": notes, "rows": rows}) + "\n")
+ if MODE == "single":
+ m = med([r["tok_s"] for r in rows if r.get("tok_s")])
+ pp = [round(r.get("pp_tok_s") or 0) for r in rows if r.get("pp_tok_s")]
+ print(f"round {rnd} {nm}: decode median {m:.2f} tok/s, pp {pp} slots {slots} {notes[:1]}", flush=True)
+ else:
+ print(f"round {rnd} {nm}: agg {[round(r['tok_s'], 1) for r in rows]} steady {[round(r['steady'], 1) for r in rows]} "
+ f"ttft {[round(r['ttft'], 2) for r in rows]} slots {slots} {notes[:2]}", flush=True)